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1  FOREWORD 


In  this  project,  a  novel  architecture  for  congestion  control  in  store-and-forward  networks 
has  been  developed  and  design  techniques  for  congestion  controllers  has  been  derived.  In  the 
framework  of  this  architecture,  each  switching  node  is  equiped  with  a  congestion  controller  which 
calculates  the  throttled  source  admission  rates  using  only  local  information  available  at  the  node. 
Each  source  receives  the  throttled  admission  rates  and  responds  by  transmitting  with  the  lowest 
one.  The  design  methodology  developed  in  this  project  leads  to  the  choice  of  the  controller  gains 
that  ensure  a  stable  congestion-free  behavior  of  the  network.  No  similar  results  are  available  in 
the  current  literature. 
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4  STATEMENT  OF  THE  PROBLEM 


Store-and-forward  datagram  networks  consist  of  switching  nodes  and  communication  links 
connecting  them  according  to  a  certain  topology.  Each  link  is  characterized  by  its  packet  trans¬ 
mission  capacity  (packets  per  unit  time).  Each  node  is  characterized  by  its  packet  storing  capacity 
(buffer  length)  and  its  packet  processing  capacity  (packets  per  unit  time).  A  node  which  reaches 
its  maximum  storing  capacity  due  to  the  saturation  of  its  processors  or  one  or  more  of  its  outgo¬ 
ing  transmission  links  is  called  congested.  Some  of  the  packets,  arriving  at  a  congested  node, 
cannot  be  accepted  and  have  to  be  retransmitted  at  a  later  time.  This  leads  to  a  deterioration 
of  the  network’s  throughput  (number  of  packets  delivered  per  unit  time).  Therefore,  congestion 
prevention  is  an  important  problem  of  store-and-forward  networks  management  (see  [l]-[9]  for 
several  classical  and  recent  publications). 

As  it  follows  from  the  above,  congestion  is  a  result  of  a  mismatch  between  the  network 
resources  (buffer  space,  processing  and  transmission  capacity)  and  the  amount  of  traffic  admitted 
for  transmission.  Consequently,  congestion  prevention  can  be  interpreted  as  the  problem  of 
matching  the  admitted  traffic  to  the  network  resources.  This,  in  turn,  could  be  viewed  as  a 
classical  problem  of  feedback  control  (matching  the  output  to  the  input  of  dynamical  systems) 
and,  indeed,  has  been  recognized  as  such  by  many  researchers  [10]-[12].  The  literature,  however, 
does  not  offer  rigorous  methods  for  congestion  controllers  design.  Nevertheless,  these  methods 
are  of  substantial  importance  since  many  designs  result  in  non-decaying  oscillation  of  the  traffic 
admitted  to  the  network  even  when  the  offered  traffic  is  constant  [13]-[15].  The  main  goal  of  this 
report  is  to  describe  an  analytical  method  for  the  design  of  congestion  controllers  that  ensures 
good  dynamic  characteristics  and  performance  of  datagram  networks  along  with  some  fairness 
in  resource  allocations. 

The  approach  used  here  is  quite  standard  [16]:  The  level  of  network  congestion  is  monitored 
through  the  buffers  occupancy.  When  the  occupancy  of  the  buffer  at  some  link  reaches  a  given 
threshold  x°,  the  congestion  controller  associated  with  this  link  calculates  a  traffic  admission  rate 
and  supplies  all  the  sources  of  its  traffic  with  the  result  of  this  calculation.  In  their  turn,  traffic 
sources  reduce  their  transmission  rate  to  the  lowest  level  allowed  by  intermediate  links. 

Given  this  architecture,  the  main  question  is  how  the  traffic  admission  rates  should  be  cal¬ 
culated  so  that  the  network  performance  is  sufficiently  good.  We  give  here  the  answer  to  this 
question  for  a  backbone  network.  Part  1  of  this  report  deals  with  the  Ccise  of  a  single  congested 
node  where  the  congestion  is  due  to  the  saturation  of  one  of  its  outgoing  links.  The  extension  to 
multiple  congested  nodes  and  links  is  presented  in  Part  2. 
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5  SUMMARY  OF  THE  MOST  IMPRTANT  RESULTS  -  PART  1  : 
CASE  OF  A  SINGLE  CONGESTED  NODE 

5.1  THE  MODEL 

5.1.1  Assumptions 

The  network 


(i) .  The  network  employs  a  store-and-forward  datagram  (or  connectionless)  service  where  users 

are  serviced  without  prior  reservation. 

(ii) .  The  network  consists  of  S  switching  nodes  and  N  communication  links.  Let  S  =  {1,2,. ..,5} 

denote  the  set  of  nodes  and  M  =  {1,2,...,  N)  denote  the  set  of  links.  For  each  node  i  £  S, 
let  0{i)  C  denote  the  set  of  its  outgoing  links. 

(iii) .  Each  link  has  a  transmission  capacity  of  of  1/t,  packets/sec,  where  t,  is  the  transmission 

time  of  a  packet,  and  a  propagation  delay  of  Tp  sec.  We  assume  that  packets  have  the  same 
fixed  length. 

(iv) .  Each  node  has  a  processing  capacity  1/Tp,  packets/sec,  where  Tp,  is  the  processing  time 

of  a  packet.  The  processing  capacity  of  each  node  is  assumed  to  be  larger  than  the  total 
transmission  capacity  of  its  incoming  links. 

(v) .  The  network  traflBc  consists  of  flows  corresponding  to  each  source-destination  pair  (t;),  t 

and  j  £  S.  The  pair  (ij)  will  be  referred  to  as  the  (li)-type  traffic  or  the  (ij)  connection. 
Let  C  denote  the  set  of  all  such  connections. 

(vi) .  For  each  (ij)  connection,  the  source  at  node  i  sends  packets  to  the  destination  at  node  j 

through  a  sequence  of  links  referred  to  as  the  path  of  the  connection  and  denoted  p(ij)- 
1  he  routing  policy  which  determines  the  path  of  each  connection  is  assumed  to  be  static. 
Let  C(k)  be  the  set  of  all  connections  (»j)  which  flow  through  link  k. 

(vii) .  Each  node  has  a  buffer  for  storing  packets  waiting  to  be  transmitted  on  one  of  its  outgoing 
links.  Let  Xj,j  £  M,  denote  the  number  of  packets  buffered  for  transmission  on  link  j  ana 
referred  to  as  link  j’s  buffer. 

The  control  architecture 

(viii).  Each  node  i  has  a  congestion  controller  which  computes,  for  each  link  j  £  0(t),  a 
quenched  transmission  rate  qj  based  on  the  difference  between  Xj  and  some  threshold 
and  on  qj  at  present  and  in  the  finite  past.  This  information  is  loc2d  to  node  t. 

(ix) .  Control  algorithm  updates  take  place  every  T  sec  where  T  is  the  time  to  transmit  c  packets, 

i.e.,  T  =  cr,.  Thus,  the  controller  time  is  slotted  with  the  slot  duration,  (n,n  -I-  l),n  = 
0,1,...,  equad  to  T. 

(x) .  Each  node  sends  the  computed  control  information  (9/s)  to  the  sources  along  the  reverse 

direction  of  the  traffic.  This  control  information  is  serviced  with  high  priority  and  is  carried 
either  in  separate  packets  or  along  with  data  or  acknowledgment  paM:kets. 

The  input  traffic 
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(xi) .  For  each  connect’on  {jk),  let  denote  the  rate  {in  packets  per  slot)  of  its  offered  traffic. 

Let  ff  =  be  the  total  rate  of  all  connections  flowing  through  link  i.  We 

assume  that  the  input  tiaffic  is  such  that  only  one  link  is  overloaded,  i.e.,  there  exists  a 
link  to  such  that  >  c  wherecis  <  c  for  all  i  ^  iq  . 

(xii) .  During  the  settling  time  of  the  system,  the  input  traffic,  satisfying  (xi),  is  constant  but 
otherwise  arbitrary  and  unknown. 

Remarks 

(1) .  Assumption  (i)  means  that  the  sources  of  the  network  traffic  can  be  slowed  down  and  do  not 

need  to  reserve  bandwidth.  In  integrated  service  networks,  where  some  traffic  types,  such  as 
voice  or  real-time  video,  cannot  be  slowed  down  and  require  a  guaranteed  transmission  rate, 
we  believe  that  our  feedback  congestion  control  scheme  can  coexist  with  a  traffic  admission 
algorithm.  The  latter  makes  decisions  regarding  bandwidth  assignment  to  sources  that 
require  a  guaranteed  transmission  rate  whereas  the  former  controls  the  sharing  of  some 
portion  of  the  bandwidth  among  traffic  sources  that  tolerate  a  certain  level  of  time  delay. 
The  interaction  between  these  two  traffic  management  procedures  needs  to  be  investigated. 

(2) .  Assumption  (iii)  assumes  that  the  network  is  homogeneous.  A  generalization  to  heteroge¬ 

neous  networks,  where  each  link  has  a  different  transmission  capacity  and/or  propagation 
delay,  is  straightforward. 

(3) .  Assumption  (iv)  means  that  links  rather  than  processors  are  the  bottlenecks.  The  case 

where  processing  is  the  bottleneck  can  be  approached  similarly.  Note  that  Tp/r,  is  the 
delay  bandwidth  product  and  is  negligible  for  a  slow  speed  network.  Since  Tp  is  constant 
for  a  given  transmission  line  but  t,  decreases  as  the  transmission  speed  increases,  the 
delay-bandwidth  product  is  significant  for  high  speed  networks  and  represents  the  number 
of  packets  being  propagated  on  the  transmission  line  (“in-the-pipe”  packets).  The  approach 
developed  in  this  work  is  applicable  to  both  processing  and  transmission  bottlenecks. 

(4) .  According  to  assumption  (v),  we  distinguish  between  traffic  types  on  the  basis  of  their 

source  and  destination  nodes  so  that  traffic  from  multiple  users  at  some  node  i  sent  to 
one  or  more  users  at  some  node  j  constitutes  a  single  connection  between  i  and  j.  The 
congestion  control  algorithm  proposed  here  can  equally  use  other  definitions  of  traffic  types. 

(5) .  The  cardinality  of  C(^)  in  (vi)  is  the  maximum  number  of  connections  that  might  simulta¬ 

neously  compete  for  the  transmission  capacity  of  link  k.  The  congestion  controller  has  to 
evenly  share  this  capacity  among  the  competing  connections. 

(6) .  Although  with  current  technology  buffers  can  be  made  very  large,  the  threshold  in 

assumption  (viii)  is  introduced  to  insure  a  desired  bound  on  the  time  delay  in  the  steady 
state  and  to  prevent  congestion  or  underutilization  of  the  transmission  capacity  during  the 
transient  periods  ^  control. 

(7) .  A  tradeoff  is  involved  in  the  choice  of  the  update  period  T,  or  equivalently  of  c  (since 

T  =  CT,),  as  will  be  discussed  in  Section  4.4.  Shorter  T's  lead  to  better  responsiveness  to 
changes  in  the  input  traffic  but  require  the  processors  to  devote  more  time  computing  the 
feedback  signals.  In  this  report,  we  choose  T  such  that  it  is  much  less  than  the  typical 
duration  of  a  communication  session  so  that  assumption  (xii)  holds. 

(8) .  Assumption  (xii)  could  be  understood  in  the  sense  that  the  input  traffic  is  piecewise  constant 

with  the  jumps  occurring  seldom  enough  so  that  the  transients  of  the  system  have  time  to 
settle  down  between  two  consecutive  jumps. 
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node  i. 


time 


Figure  5.1:  Network  delay. 


5.1.2  Buffer  equations 

Although  the  offered  traffic  in  backbone  networks  is  typically  random,  we  use  a  deterministic 
fluid  flow  description.  The  reason  is  that,  under  certain  assumptions,  the  stochastic  nature  of  the 
offered  traffic  can  be,  in  the  first  approximation,  averaged  using  asymptotic  techniques  [17]-[18]. 
The  resulting  equations  coincide  with  the  fluid  approximation  used  here.  Therefore,  to  simplify 
the  presentation  and  eliminate  technical  details,  we  begin  directly  from  the  fluid  flow  description. 

Let  Xi(n)  denote  the  occupancy  of  the  buffer  of  link  i  at  time  n.  Let  /t(n)  denote  the  total 
rate  at  which  traffic,  both  new  and  transit,  is  flowing  through  link  i  during  the  [n,n  +  1)  slot. 
Then,  the  dynamics  of  buffer  i  is  described  by  the  following  difference  equation: 


a:i(n  +  1)  =  sg{x,(n)  +  /i(n)  -  c},  t€  N, 


where 


sg(®) 


_  f  X  if 
“  \  0  of 


if  X  >  0, 
otherwise. 


Since,  /,(n)  <  /p  (admitted  traffic  <  offered  traflflc)  and  /P  <  c  for  i  ^  to  (assumption  (xij), 
then 

x,(n}  =  0,  Tt  =  0, 1, . . . ,  Vt  ^  to,  (5.2) 

assuming  that  buffers  are  initially  empty.  This  implies  that  traffic  will  incur  no  queueing  delay 
at  buffers  of  non-overloaded  links. 

Let  rjfc(n)  denote  the  rate  at  which  connection  fjfc)  has  been  admitted  to  the  network  during 
[n,n  -i- 1).  Then,  the  total  amount  of  traffic  arriving  at  buffer  to  during  [n,n  +  1)  is 

/<o(")=  S  (5-3) 

(i*)eC(<o) 

where  C'(to)  is  defined  in  assumption  (vi)  and  fjig  =  Tji^/T  is  the  delay,  measured  in  time  slots, 
that  the  traffic  incurs  from  its  point  of  ent^  to  the  network  at  node  j  until  it  arrives  at 
buffer  to,  while  is  the  sum,  along  the  path  oi{jk)  from  j  to  to,  of  all  transmission,  propagation 
and  processing  delays.  Since  the  network  time  is  slotted,  when  is  not  an  integer  multiple  of 
r,  we  rewrite  (5.3)  as  follows  (see  Figure  5.1): 


/«o(”)  ~  ^  (1  ^i»o)  d"  ^i»o  "h  Ij, 

(jfc)€C(io) 
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where 


djig  =  ffyiol  :  the  smallest  integer 

^i.oe[0, 1). 

Note  that  dji^  and  are  physical  parameters  of  the  network, 
link)  we  have 

»  T'*  d"  Tp  d"  ’^pr  1  d"  Tpr  ^ 

CT,  C  CTf 

Therefore,  as  the  network  speed  increases  (t,  decreases),  d  increases  and  results  in  an  incre<ise 
in  the  dimension  of  the  closed  loop  equations  (see  Section  3  below). 

Substituting  (5.4)  in  (2.1)  we  obtain  the  buffer  equation  for  the  overloaded  link: 

a;.o(«  d-  1)  =  Sg  I  a:.o(n)  d-  (1  -  ^j.o) “  ^jio)  d-  rjk{n  -  d-  1)  -  c  I  .  (5.7) 

(  Uk)eC(io)  ) 


(5.5) 

Along  one  hop  (i.e.,  through  one 
d-e.  (5.6) 


5.1.3  Controller 

Idea  of  the  control  law 

The  idea  of  the  congestion  controller  employed  in  this  work  can  be  illustrated  as  follows: 
Consider  a  single-node  network  with  a  traflBc  source  of  rate  r  and  an  outgoing  link  with 
capacity  c,  where  r  >  c.  A  congestion  controller  is  supposed  to  quench  the  offered  traffic  so  that 
the  steady  state  buffer  occupancy  at  the  node  is  a  given  number  x°.  The  quenched  source  rate 
q(t)  <  r,  defines  the  part  of  the  offered  traffic  that  will  be  admitted  to  the  network.  Assuming, 
for  simplicity,  that  all  variables  are  continuous,  the  dynamics  of  the  buffer  occupancy,  x(t),  can 
be  described  as  follows: 

X  =  g  —  c. 

If  the  proportional  control  law  is  used,  the  quenched  transmission  rate  obeys  the  equation 

g  =  —ao(x  —  x°). 


This  results  in 

X  d-  orox  =  OoX°, 

and  both  the  buffer  occupancy,  x(t),  and  the  admitted  traffic,  g(<),  exhibit  non-decaying  oscilla¬ 
tions  (  if  oo  >  0;  otherwise  the  system  is  unstable  ). 

To  eliminate  this  problem,  a  proportional-plus-derivative  control  law  can  be  utilized: 

g  =  —ao(x  —  X®)  —  ttix.  (5.8) 

Then, 

X  d-  aix  d-  QqX  =  (5.9) 

and  x(t)  and  g(i)  converge  to  x°  and  c,  respectively  (if  oo  and  oi  >  0).  Moreover,  the  speed  of 
the  convergence  can  be  assigned  arbitrarily  by  an  appropriate  choice  of  oq  and  ai . 

In  networks  with  multiple  switching  nodes,  however,  PD-controllers  will  not  work  either.  The 
reason  is  that,  due  to  delays  in  information  transmission  between  the  nodes,  the  buffer  occupancy 
at  each  node  is  described  by  a  time-delay  equation  of  the  form 

x  =  g(t-T)-  c. 
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where  t  >  0.  In  this  c&se,  the  closed  loop  system  may  be  oscillatory  even  if  the  PD  controller 
(5.8)  is  employed.  The  main  idea  of  this  work  is  to  combat  this  difficulty  by  constructing  a 
controller  of  the  form 

q{t  —  t)  =  —aQ{x{t)  —  x”)  —  Qix(<). 

In  this  case,  the  closed  loop  behavior  is  still  described  by  (5.9),  and  any  desired  dynamics  can  be 
achieved.  The  question  is  whether  such  a  controller  can  be  constructed  for  various  types  of  input 
traffic  patterns  that  result  in  different  r’s.  It  turns  out,  however,  that  it  is,  indeed,  possible,  and 
the  equations  for  such  a  controller  are  given  below. 

Controller  equation 

The  congestion  controller  includes  two  parts;  the  control  algorithm  and  the  control  protocol. 
The  control  algorithm  calculates  the  quenched  source  transmission  rate  and  the  control  protocol 
specifies  how  the  traffic  sources  react  to  these  quenched  transmission  rates. 

The  following  control  protocol  is  used  in  this  work:  Assume  that  9,(n  +  1),*  G  is  the 
quenched  transmission  rate  calculated  at  time  n  by  the  node  for  which  link  i  is  an  outgoing  link. 
Then,  during  the  time  slot  [n,n  +  1),  the  (jA:)-type  traffic  is  admitted  with  the  rate 


rjfc(n)  =  min{gm(n  +  1  - 'rmj),m  e  p(ifc);r“jt},  {jk)eC,  (5.10) 


where  Tmj  is  the  delay  incurred  by  the  feedback  signal  q^.  to  reach  node  j.  In  compliance  with 
this  expression,  the  source  admission  rate  is  defined  by  the  smallest  among  all  transmission  rates 
corresponding  to  the  links  along  the  path  p{jk)  and  the  desired  transmission  rate.  Since  qm  is 
generated  every  T,  the  most  recent  feedback  signal  available  at  node  j  at  time  n  is  9,„(n  + 1  ~dmj) 
where  dmj  —  [Tmil-  Therefore,  equation  (5.10)  becomes 

rjfc(n)  =  min{<7m(n  +  1  -  dmj),Tn  e  p{jk);  r%},  {jk)  €  C.  (5.11) 

The  control  algorithm  is  defined  by  the  following  equations: 


qi{n  +  1)  =  Sat,o 


f 


j=o 


^kqiin  -  <:)  | ,  i  G  A/", 

k=o  ) 


(5.12) 


where  q°  >  c,  J  and  K  are  non-negative  integers  and 


Sata(z) 


0  if  z  <  0, 

-  a  if  z  >  a, 
z  otherwise  . 


The  saturation  function  Sat,o(.)  in  (5.12)  is  introduced  to  impose  bounds  on  9<’s.  The  lower  bound 
zero  keeps  g,  >  0  whereas  the  upper  bound  g®  limits  the  initial  sending  rate  of  connections  with 
uncongested  path. 

When  J  =  \  and  K  =  Q,  (5.12)  results  in  the  PD-controller 

qi{n  -f  1)  =  Sat,o{g<(n)  -  a(a;i(n)  -  z°)  -  b{xi{n)  -  ii(n  -  1))},  (5.13) 

where  a  =  oq  -1-  Oi  and  b  =  — Oi. 

As  it  is  shown  below,  the  control  gains,  a,  and  in  (5.12),  must  satisfy,  among  others,  the 
following  requirements: 

J  K 

=  (5.14) 

j=o  k=o 
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Since,  according  to  (5.2),  x,(n)  =  0,n  >  0,  for  i  ^  to,  solving  (5.12)  under  conditions  (5.14)  we 
obtain  g,(n)  =  9°,  n  >  0,  t  ^  to  (assuming  qi{n)  =  n  <  0,  i  ^  to).  Therefore,  underloaded 
links  have  their  buffers  at  zero  and  their  control  signals  equal  to  This  implies  that,  for  all 
connections  (jk)  €  C'(to),  equation  (5.11)  becomes 

r^kin)  =  min{9,o(n  +  1  -  d,oj),r°t},  {jk)  e  C(to).  (5.15) 

As  it  follows  from  (5.12),  the  control  algorithm  is  defined  by  J+  A'  +  2  control  gains  a,  and  0i. 
In  the  next  section,  the  analysis  of  the  closed  loop  behavior  of  (5.7),  (5.12)  and  (5.15)  for  given 
a’s  and  /3’s  is  described  and  a  method  for  choosing  a’s  and  /?’s  that  ensure  high  delay-throughout 
characteristics  is  given. 


5.2  ANALYSIS 

5.2.1  Closed  loop  equations 

As  it  follows  from  the  previous  section,  the  closed  loop  behavior  of  the  network  with  io  as  the 
single  overloaded  link  is  described  by  the  following  equations: 


^ioin  +  1)  =  sg  ^  lio(n)  +  X]  (1  ”  ^iioVikin  -  dji^)  +  eji^rjkin  -  dji^  +  1)  -  c  X5-16) 
[  (Jk)€C(io)  ) 

rjk{n)  =  min{g.<,(n  +  1  -  di^j),r°-,^},  (jk)  €  C'(io),  (5.17) 


9<o(n  +  1)  =  Satqo  i  qi^(n)  -  “  J)  “  -  *)  |  • 

[  j=0  fc=0  J 


Equation  (5.17)  can  be  rewritten  as  follows: 


where 


=  ^jk{n)  9.o(n  +  1  -  d,„)  +  (1  -  /),fc(n))  rj*  , 


Combining  equations  (5.16)  and  (5.19),  we  obtain 


a;io(«  +  1) 


=  S8|n«(")+  s  +  !-<*,)+ 

I  0*)€O(i,, 

-  dji,  +  +  1  -  (i)j  -  1))]  +  r?  (n)  -  c}  , 


(5.17) 

(5.18) 


(5.19) 


(5.20) 


(5.21) 


where 


rlin)  =  E  (l-Mn-^o^a-^iioh^fc  +  Cl-Mn-^iiio  +  mor^, 

(jfc)€C(<o) 

dj  =  dji,+di,j.  (5.22) 

When  Sjk{n)  =  1,  the  (jk)  traffic  is  being  quenched  during  [n,n+l),  otherwise  (when  ^jfc(n)  =  0) 
it  is  sMlmitted  with  its  desired  transmission  rate  and  is  the  cumulative  rate  of  all  unquenched 
flows.  We  will  refer  to  dj  as  the  round  trip  delay  of  connection  (jk). 
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Equation  (5.21)  can  be  rewritten  as 


f.o(«  +  1)  =  sg  +  SA(«)9.o(«  +  1  -  i)  +  ’  (^-23) 


/j(n)  —  ^  ^jk{n  ^jio)  +  <^jio  +  l)^j«o »  (5.24) 

Ofe)eC‘  (ji:)€C'+» 

D  =  max  dj ,  (5.25) 

Ofc)eC(.o) 


where 


=  {(jA:)  e  C(to)  :  d,  =  (/}, 


i.e.,  is  the  set  of  all  connections  flowing  through  link  to  with  round  trip  delay  equal  to  d.  The 
/,’s  can  be  interpreted  as  the  number  of  quenched  flows  with  round  trip  delay  equal  to  i  time 

slots.  Note  that  I  =  ~  12(jk)eC{io)  is  the  total  number  of  connections  being  quenched 

by  link  t'o  and  is  a  positive  number  since  link  io  is  overloaded  and  therefore  at  least  one  connection 
is  quenched. 

Omitting  the  index  to,  the  closed  loop  equations  become 


)  -  c|  , 

(5.26) 

K  1 

53  Mn  -  fc)  >  . 

fc=o  J 

(5.27) 

Note  that  since  (5.26)  involves  delayed  versions  of  q{n)  up  to  q{n  —  {D  —  1)),  it  is  natural  to 
assume  that  K  >  D  —  1.  Equations  (5.26)-(5.27)  describe  &  {J  +  K  +  2)-dimensional  system 
with  the  state 

Y (n)  =  [x(n)  -  X®,  x(n  -  1 )  -  x“, . . . ,  x(n  -  J)  -  x®,  ^(n),  ^(n  -  1 ), . . . ,  ^(n  -  A')]  ^ . 

The  steady  states  and  dynamic  properties  of  this  system  are  described  below. 

5.2.2  Steady  states 

Let  x«  and  q,  be  the  steady  state  values  corresponding  to  equations  (5.26)  and  (5.27)  under 
the  assumption  that  the  input  traflSc  is  constant.  Then, 


=  sg  ja;#  +  (S /.)?.  + r®  -  c| , 

q,  =  Sat,o  |(1  -  53  ^k)q,  -  (53  |  • 

^  fcso  i=o  J 


(5.28) 

(5.29) 


Figures  5.2. a  and  5.2.b  show  the  solutions  to  equations  (5.28)  and  (5.29),  respectively.  The 
combined  solution  is  shown  in  Figure  5.2.c  and  corresponds  to 


7.  =  — > 

_  0  12,ksoPk 


(5.30) 
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Figure  5.2:  Steady  state. 


In  order  to  ensure  that  x,  =  we  choose  so  that 

=  (5.31) 

fc=0 


Thus,  the  steady  state  V,  =  (0, . . . ,  0, 9,, . . . ,  9,)^  exists  if  and  only  if  the  vector  of  control 
parameters 

Q  =  {qq,  . . .  ,ajy Pq, . . . , (5.32) 
satisfies  constraint  (5.31).  Note  that  q,  in  (5.30)  can  be  rewritten  as  follows; 


9.  = 


M  I 


This  expression  presents  the  following  fairness  property:  If  M  connections  share  a  transmission 
link,  then  each  gets  1/Af  of  the  bandwidth  and  if  (M  —  1)  connections  use  less  than  their  share 
(i.e.,  only  /  connections  are  quenched),  then  the  unused  portion  ((M  —  l)j^  —  r°)  is  equally 
distributed  among  the  rest. 


5.2.3  Transient  analysis 

To  study  the  local  stability  properties,  we  simplify  the  dynamic  equations  for  Y  in  the  neigh¬ 
borhood  of  Yt  by 

(a)  removing  the  saturation-type  n^  nlinearities  (sg(.)  and  Sat,o(.))  in  (5.26)  and  (5.27)  since 
they  are  not  activated  for  small  deviations  around  Y,  ((x„q,)  is  in  the  interior  of  [0,c»)  x 
[0,9°]); 
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(b)  treating  l,{n)  and  r°(n)  as  constants  since,  based  on  equation  (5.20),  there  exists  a  ball 
around  within  which  Sjk  is  constant  (assuming  that  9i-(i^)  ^  ^^(*o))- 

The  resulting  equations  are 

D 

i(n  +  l)  =  x(n)  +  ^ /,  g(n  +  1  —  i)  4- r°  —  c,  (5.33) 

i=0 

J  K 

q{n  +  l)  =  q{n) -'^aj{x{n  -  j)  -  x°) 0kq{ri  -  k).  (5.3-J) 

j=0  k=0 

Theorem  5.1  For  any  given  lo,  /i,  •  •  • ,  Id,  the  poles  of  the  closed  loop  system  (5.33)-(5.34)  can  bt 
placed  at  will  by  an  appropriate  choice  of  the  gains  Oo, . . . ,  Qj,  $0, . . . ,  ,  Ylk=o  3k  =  0-  if  J  =  I 

and  K  —  D.  In  other  words,  a  PD  controller  with  respect  to  x  and  a  controller  of  order  D  with 

respect  to  q  are  sufficient  to  ensure  any  desired  dynamics  of  the  closed  loop  system  (5.33)-(5.34) ■ 

□ 


Proof:  See  Appendix  1. 

As  it  follows  from  the  proof,  the  characteristic  polynomial  of  the  closed  loop  system  can  be 
represented 

/>(A)  =  (-l)“+‘APp(A), 

where 

/i-(A)  =  A“«  +  7.A‘’+'  +  7,A®  +  . . .  +  (5.35) 

and  the  coefficients  7,,  t  =  1, 2, . . . ,  Z)  +  2,  are  uniquely  defined  by  the  control  gains 

T* 

Q  =  (ao,ai,/3o,j9i,...,j3i,)  . 

Therefore,  as  it  follows  from  (5.35),  one  of  the  closed  loop  poles  is  at  0  and  the  remaining  D  +  2 
poles  can  be  chosen  at  will.  It  is  shown  in  the  Proof  of  Theorem  5.1  that  for  any  desired  set  of 
coefficients  7,-,  t  =  1,2, . . . ,  +  2,  the  corresponding  control  gain  Q  is 


g  =  [M(L)]-^r, 


(5.36) 


where 


M(L)  = 


lo  0  1 

h  Iq  —1  1 
h  h  -1 


Id  Id~i 
0  Id 
0  0 


]  1 


-1  1 
-1 


7i+2 

72-1 

73 

74 

7d+i 

'Id+2 

0 


As  it  is  shown  in  Appendix  1,  expression  (5.36)  can  be  rewritten  in  an  alternative  form  shown 
below: 

T  =  Ti^  +  WqL,  (5.37) 
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where 


1  ^ 

72 

73 

II 

7jD+i 
\  7d+2  J 

/?o-2 

3q  +  \ 
02  ~ 

3z  ~  ^2 

3d  ~  3d-\ 
~3d 


\ 


} 


I  cto 
Ql  Qo 


Wo  =  (Vo  VI  ...Vd)  = 


Oi 


\ 


ao 

«i  / 


Both  of  these  expressions,  (5.35)  and  (5.37),  will  be  used  in  Section  4  below  for  design  purposes. 
Concluding  this  section,  we  note  that  the  sum  of  the  coefficients  of  Pp(A),  1  +  is 

equal  to  (qq  +  qj  )  Since  it  is  necessary  for  asymptotic  stability  that  this  sum  be  positive, 

do  +  Oi  has  to  be  positive  as  stated  in  (5.14). 


5.3  DESIGN 

5.3.1  Adaptive  vs.  robust  design 

The  design  of  the  congestion  controller  (5.12)  involves  the  computation  of  the  parameters 
of  the  control  law,  i.e.,  the  vector  of  control  gains  Q  =  (ao,0'i,jdo»i^j> •  •  •  »/^£))^-  As  it  has 
been  shown  in  Section  3,  the  closed  loop  dynamics  depend  on  the  number  of  quenched  flows 
^  =  (^0)  •  •  • ,  1  where  U  is  the  equivalent  number  of  quenched  flows  with  round  trip  delay 

equal  to  i.  Therefore,  if  each  node  can  take  into  account  the  variations  of  L  when  computing 
the  control  law,  the  resulting  design  is  referred  to  as  adaptive;  here  Q  is  updated  whenever  L 
changes.  If  information  about  L  is  not  available,  a  robust  design  has  to  be  considered;  here  the 
control  law  is  implemented  with  a  fixed  Q  so  that  stability  and  performance  requirements  are 
satisfied  for  all  admissible  values  of  L. 

Note  that  an  adaptive  design  has  the  advantage  of  achieving  good  performance  but  at  the 
expense  of  higher  computation^  requirements  (the  updating  algorithm  for  Q)  whereas  a  robust 
design  requires  less  computations  but  the  achieved  performance  may  be  inferior.  Also,  in  order  to 
be  able  to  implement  an  adaptive  design,  the  congestion  control  protocol  should  be  implemented 
in  such  a  way  that  L  can  be  known  by  the  switching  nodes.  One  way  of  doing  so  is  to  stamp 
each  packet  with  the  identity  of  the  quenching  link,  if  any.  In  this  way,  every  node  can  maintain 
a  table  of  quenched  flows.  Each  of  these  design  approaches  are  investigated  below. 

5.3.2  Adaptive  design 

Suppose  that  the  desired  performance  of  the  congestion  control  system  is  specified  in  terms 
of  closed  loop  poles  that  correspond  to  the  vector  of  characteristic  polynomial  coefficients  F  = 
(7n72» •  •  •  »7i?+2)^-  Then,  ris  it  follows  from  (5.36),  the  adaptation  of  the  control  gain  Q  = 
(qo,  Oi,  /?o,  . . . ,  3d)^  to  changes  in  L  takes  the  following  form: 

Q(n)  =  (M(L(n  -  I))l-'f,  (5.38) 

where  L(n)  =  (k(n),l\(n),...,lp{n))^  andf  =  (-|r, +2,73-1,73,...,7d+2>0)’'.  Note  that  Q{n) 
depends  on  L  at  time  n  —  1  since  at  time  n  only  L(n  —  1 )  is  available.  The  performance  of  the 
network  utilizing  the  adaptive  control  law  (5.38)  is  illustrated  in  Section  5  below. 
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5.3.3  Robust  design 

The  goal  of  this  subsection  is  to  find  a  fixed  gain  Q  —  (oo-Oi.  Jq.  Jj . ensures 

stability  of  the  closed  loop  system  (5.33)-(5.34)  for  all  values  of  L  belonging  to  an  admissible  set 
£  defined  as 

£  =  (£ox£i  X  ...  X  £0)- {0},  £.  =  [0,/'].  t  =  0.1 . £).  (5  39) 

where  1,  is  the  maximum  equivalent  number  of  quenched  flows  with  round  trip  delay  equal  to  i. 
From  (5.24)  it  is  given  by 

/.=  1;  (5-10) 

Ofc)eC‘ 

where 

C‘^  =  {(jk)eC(to):d,  =  d}. 

The  solution  of  this  problem  is  given  by  the  following  two  theorems: 


Theorem  5.2  There  exists  a  positive  number  k'{L)  where  L  =  {loJi . Ip)^  such  that  the 

closed  loop  system  (5.33)-(5.34)  is  asymptotically  stable  for  any  L  £  C  if  the  control  gams  are 
chosen  as 

Q  =  Qk  =  {kaQ,kai,0o,l3y,...,f3uf.  k  e  (O.A-*), 

where 


oo  = 

at  = 
00  — 
0i  = 


Z)  +  4 
2(I>  +  1)  ’ 
£>  +  2 


2(£>  +  l)’ 
3D 

2(D  + 1)  ’ 
D-2(»-H) 
2(D  +  1) 


,  i  =  1,2,...,D. 


□ 


Proof:  See  Appendix  2. 


Thus  the  robust  control  gain,  Qki  is  the  (D  +  3)-dimensional  vector  with  components  defined 
in  Theorem  5.2. 

Let  Se  be  the  surface  in  defined  by  the  equations 


Si,: 


[ 


E^'i^7<cos(t0)  =  -1, 
E£iS<sin(t^)  =  0,  ^  €  (0,7r), 


and  let  the  inequality  L  <  L  imply  the  component  wise  inequalities  /<  <  L,  t  =  0, 1, . . . ,  D. 
Theorem  5.3  The  positive  number  k‘,  referred  to  in  Theorem  4.I,  is  defined  as 


k*  =  niin{A:i,  ^2}. 

Here, 

k  -  -b  5  +  (-l)^(D -I- 3) 
2{c  +  3)5;!S'^?2i 
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and  k2  is  the  solution  of  the  following  optimization  problem: 

minimize  k  subject  to  the  constraints  (5-41) 

k>Q, 

Tyij  +  WcuL  €  S$, 

Q<L<ki, 

where  F ^  and  Wa  are  defined  in  (5. 37).  If  the  solution  of  this  optimization  problem  does  not 
exist,  k2  =  +CX). 

Proof:  See  Appendix  2. 


Thus,  the  design  of  the  robust  congestion  controller  can  be  accomplished  in  two  stages.  First, 
the  optimization  problem  of  Theorem  5.3  is  solved  and  k*  is  determined.  At  the  second  stage, 
a  specific  gain  Qk  is  chosen  from  the  family  defined  in  Theorem  5.2  so  that  the  performance 
requirements  are  satisfied  as  much  as  possible.  This  design  procedure  is  illustrated  in  Section  5 
below. 

For  each  6,  the  optimization  problem  of  Theorem  5.3  is  a  linear  programming  problem. 
Indeed,  we  minimize  a  linear  function,  k,  subject  to  the  following  liner  equality  and  inequality 
constraints  obtained  by  substituting  in  (5.41)  the  expressions  of  F Wa  ^d  S$: 


*  >  0, 

0  <  /.  <  kli,  *  =  0,1,...,I>, 


(5.42) 


wh.6f€ 

aj(6/)  =  Q:ocos((t  +  1)0)  +  tti  cos((t  +  2)0), 

6,(0)  =  ao  sin((t  +  1)0)  +  ai  sin((»  +  2)0), 

ci(0)  =  -1  -  2cos(0)  +  cos(20)  +  ^i(cos((i  +  1)0)  -  cos((t  +  2)0)), 
C2(0)  =  -2sin(0)  +  sin(20)  +  I^/9,.(sin((r  +  1)0)  -  sin((t  +  2)0)). 


Therefore,  if  k2(3)  denotes  the  result  of  the  above  minimization,  the  solution  of  the  optimization 
problem  (5.41)  can  be  found  as 

fcj  =  inf  ^2(0) . 


Practically,  an  approximate  solution  can  be  found  by  discretizing  the  interval  (0,?r)  as  0,-  = 
»  =  1, 2, . . . ,  AT,  solving  the  AT  resulting  LP  problems,  and  choosing  the  smwest  of  the  N 
numbers.  This  procedure  is  illustrated  below. 

To  conclude  this  subsection,  we  consider  an  example  of  calculating  k*  for  a  particular  network. 
Consider  a  network  with  2D  +  3  nodes  connected  according  to  a  bidirectional  ring  topology  with 
the  minimum-hop  routing  strategy.  If  the  controller  update  period  T  is  equal  to  the  delay  along 
one  hop  (transmission  -H  propagation  -|-  processing),  then  L  is  given  by 


f  hi  =  D  \  ~  iy 
\  hi+i  =0,  *  =  0, 1, . . . ,  P. 


Table  (5.1)  shows  ki,  ^2  for  different  values  of  D.  Note  that  k*  is  a  decreasing  function  of 

D  since,  as  D  increases,  the  network  size  increases  and  therefore  the  number  of  flows  that  might 
be  active  simultaneously  increases  and  this  requires  a  smaller  gain  in  order  to  insure  stabiL  .y  for 
any  admissible  vector  L  of  quenched  flows. 
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D 

1 

2 

3 

'  1 

4 

5 

6 

7 

8 

9 

Ell 

0.533 

0.286 

0.178 

0.121 

0.088 

0.067 

0.052 

0.042 

0.035 

di 

0.640 

0.340 

0.196 

0.137 

0.089 

0.069 

0.050 

0.049 

0.029 

191 

0.533 

0.286 

0.178 

0.121 

0.088 

_ 

0.067 

0.050 

0.042 

0.029 

Table  5.1:  Values  of  k”  for  a  ring  network. 


5.3.4  The  update  period 


Both  the  robust  and  the  adaptive  design  approaches  require  the  selection  of  the  update  period 
T  for  the  controller  (  see  assumption  (ix)  in  Section  2).  The  value  of  T  affects  both  the  transient 
response  and  the  control  overhead  due  to  the  computation  and  transmission  of  the  feedback 
information. 

The  settling  time  and  the  buffer  overshoot  are  the  main  characteristics  of  the  transient  re¬ 
sponse.  The  settling  time,  t,,  is  the  time  interval  between  the  start  of  transmission  and  the  time 
when  the  transmission  rate  reaches  and  remains  in  the  5%  neighborhood  of  its  steady  state  value. 
Obviously, 

ts  >  RTD  -f  KiT, 


where  RT D  is  the  round  trip  delay  and  /Ci  >  0  is  a  constant  defined  by  the  control  law.  If  N  is 
the  average  number  of  packets  to  be  transmitted  per  connection  and  M  is  the  average  number 
of  connections  sharing  the  link,  the  ratio  of  settling  time  to  transmission  time  of  a  connection, 
tc,  can  be  characterized  as 


is  ^  RT D kiT 
Tc  -  nmt. 


(5.43) 


The  buffer  overshoot  Ax  can  be  evaluated  as  follows: 


Ax  =  X  —  x°  >  {RTD  +  K2T)kc,  (5.44) 

where  x®  is  the  desired  buffer  occupancy,  kc  =  k/r,  is  the  excess  rate  beyond  the  link  capacity 
c,  and  K2  >  0  again  depends  on  the  control  law  .  The  inequalities  in  (5.43)  and  (5.44)  are  due  to 
the  fact  that  the  control  action  cannot  start  before  the  round  trip  delay  nas  elapsed  and  would 
require  a  number  (xi  or  K2)  of  update  periods  to  reach  either  the  steady  state  or  the  maximum 
buffer  occupancy.  From  these  inequalities  we  see  that  faster  updates  fi.e.,  smaller  T  )  lead  to 
shorter  settling  time  and  smaller  buffer  overshoot  which  are  some  of  tne  desirable  features  for 
the  network. 

On  the  other  hand,  the  decrease  in  T  leads  to  an  increase  in  the  control  overhead.  Indeed, 
if  To  is  the  time  necessary  for  the  node  to  compute  and  transmit  the  control  signals  (feedback 
information)  every  update  period  T,  then  Tq/T  is  the  control  overhead.  The  time  tq  is  smaller 
when  the  network  speed  is  higher  and  therefore,  it  can  be  assumed  proportional  to  r,  (tq  =  X3T,). 

Given  these  performance  criteria,  the  choice  of  the  update  period  T  can  be  approached  as  a 
multicriteria  optimization  problem  and  an  appropriate  Pareto  set  can  be  calculated.  However,  if 
we  assume  that  there  exist  penalties  1/1 , 1/2,  and  1/3  for  settling  delay,  queueing  delay,  and  control 
overhead,  respectively,  then  the  following  single  function  of  T  should  be  minimized  in  order  to 
determine  the  compromise  value  of  the  controller  update  period: 

7trr\_.  RTD-^KiT  .  .  «3r, 

J{T)  -  Vx - - V2{RTD-^  ''2^)—  +  ^3-^- 

The  solution,  obviously,  is 

V3H3 

*'17^  +  ^2^2*' 
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Figure  5.3:  Admissible  set  of  update  periods. 


This  solution  assumes  that  no  constraints  on  the  selection  of  T  are  imposed.  Often  it  is  the  case, 
and  the  minimization  of  J{T)  should  take  place  over  some  admissible  set  T  resulting  from  the 
following  requirements: 

(a).  Ratio  of  settling  time  to  transmission  time  of  a  connection  less  than  some  constant  <  1: 


ETD  +  /ciT 
NMt, 


<^i. 


(b).  Buffer  overshoot  less  than  62; 


{BTD  +  KiT)^  <  62. 


(c).  Control  overhead  less  than  ^3  <  1: 


<  ^3. 


(5.45) 


(5.46) 


(5.47) 


From  constraints  (5.45)-(5.47),  we  obtain  the  admissible  set  T  as  a  function  of  r,  (see  Fig¬ 
ure  5.3).  This  figure  is  obtained  under  the  assumption 


/C3  .  f  NM61  62  1 


(5.48) 


K  (5.48)  is  not  satisfied,  the  set  T  is  empty,  otherwise,  T  =  [Ti,r2]  where 


«3 

Tl  =  -j-T,, 

03 


.  (NMSit.-RTD 

T2  =  mm< - ,-5 - 

L  «2  J 


Let  T*  be  the  value  of  t,  for  which  ti  =  T2  (see  Figure  5.3).  Then,  if  t,  >  r*,  the  constrained 
optimad  update  period  is 

(  To,  if  To  €  [ti,T2], 

r*  =  ^  Tl,  if  To  <  Tl, 

I  T2,  if  To  >  T2. 
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Section  5  below  illustrates  the  effects  of  T  on  the  transient  behavior  of  the  network  using  nu¬ 
merical  simulations. 


5.4  DESIGN  EXAMPLE  AND  NUMERICAL  SIMULATIONS 

This  section  presents  a  design  example  and  simulation  results.  We  start  by  describing  the 
network  and  the  input  traffic.  Then,  we  carry  out  both  the  robust  and  adaptive  designs  followed 
by  an  examination  of  the  effects  of  the  update  period  T  and  of  the  randomness  in  the  input 
traffic.  Finally,  we  illustrate  the  recovery  of  the  network  from  congestion. 

5.4.1  The  network  and  the  input  traffic 

Consider  a  network  where  links  have  a  delay-bandwidth  product  of  10  packets,  i.e.,  the 
propagation  delay  over  a  link  corresponds  to  the  time  for  transmitting  10  packets.  This  is  the 
case,  for  instance,  of  45  Mbps  channels  when  1  kbyte  packets  are  sent  over  a  340-mile  link.  Let 
T,  be  the  transmission  time  of  a  packet  and  let  c  be  the  transmission  capacity  in  packets/slot 
where  the  slot  duration  is  equal  to  the  update  period  T  {T  =  cr,). 

For  this  design  example,  we  assume  that  the  network  topology,  and  the  input  traffic,  are  such 
that  the  following  properties  are  satisfied: 

(a) .  Only  one  link  is  overloaded. 

(b) .  The  input  traffic  is  such  that 

no  =  4, 

ni  =  3, 

»2  =  2, 

"3  =  1, 

rii  =  0,  I  >  3, 

where  is  the  maximum  number  of  connections  that  can  flow  through  the  overloaded  link 
with  the  source  node  located  t  hops  from  this  link. 

These  properties  are  satisfied,  for  instance,  by  the  network  and  the  traffic  shown  in  Figure  5.4 
and  Table  5.2,  respectively.  Figure  5.4  shows  only  a  subset  of  the  network  nodes  along  with 
the  sources  of  the  five  connections  labeled  according  to  the  first  column  of  Table  5.2.  This  table 
describes  the  activity  of  these  sources  during  the  1000  time  slots  of  the  experiment  where  the  slot 
duration,  Ti,  is  defined  below.  The  presence  of  the  other  five  unlabeled  connections  as  potential 
traffic  sources  is  taken  into  account  in  the  design  of  the  controller.  The  destination  nodes,  which 
are  not  shown  in  Figure  5.4,  can  be  any  of  the  nodes  downstream  of  node  A.  Note  that  the  input 
traffic  becomes  heavy,  i.e.,  larger  than  the  link  capacity,  starting  from  time  t  =  lOOTj. 
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Connection  # 

^  of  hops 

initiated  at  time 

terminated  at  time 

1 

0 

50 

700 

0.6 

2 

0 

250 

1000 

0.7 

3 

1 

100 

850 

0.6 

4 

2 

400 

1000 

0.5 

5 

3 

550 

1000 

0.4 

Table  5.2:  Input  traffic. 


5.4.2  Robust  design 

As  it  follows  from  Figure  5.4,  the  largest  round  trip  propagation  delay,  RT D,  corresponds 
to  6  hops:  3  hops  in  each  of  the  forward  and  reverse  paths  of  connection  5.  Since  the  delay 
bandwidth  product  is  assumed  to  be  10  and  the  transmission  time  of  a  packet  is  r,,  this  implies 
that  RTD  =  6  X  IOt,  =  60t,.  We  choose  the  update  period  to  be  equal  to  the  largest  round  trip 
propagation  delay,  Ti  =  60r,,  i.e.,  c  =  60,  and  choose  =  30  packets. 

Let  f,y|  denote  the  delay,  measured  in  time  slots  Ti,  that  connections  originating  i  hops  from 
node  A  incur  until  they  arrive  at  node  A.  Then,  neglecting  the  processing  delay,  and  using 
equations  (5.6),  (5.5)  and  (5.22)  we  have,  respectively, 

IhA  =  0 

.  _  Tj+Tp  _  \\T,  _  n 

~  cT.  —  60T,  “60  ^ 

i  _  0.?  —  22  ^ 

^TiA  —  ^^lA  —  eg 

hA  =  3fi^  =  I 

Thus,  the  maximum  time  delay  D,  as  defined  by  (5.25)  is  «.qual  to  2.  Therefore, 


dox  =  u,  =  u 
dxA  =  m]  =  1,  =  1  -  g 

d2A  =  [|l  =  1,  =  1  -  I 

d,.  =  ril  =  1.  =  1  -  i 


_  ^ 


Qk  =  {kaQ,kai,0o,0i,^2V,  k  €  (0,^), 


(5.49) 


where,  as  it  follows  from  Theorem  5.2, 


—  P4-4  _  1 

“  2(D+1)  “ 

a,  = _ e±a_  =  . 

7- 

Po  -  2(3+1)  “ 

“  2(D+1}  ~ 

=  _g=8^  =  _9/.3 


2(D+1) 


=  -2/3, 


and 


where,  as  it  follov.’s  from  (5.40), 


L  =  {kJi,kf, 


Ip  =  «o(i  —  ^o>i)  =  4, 

Ij  =  niOiji  +  n202A  +  ”3^3y4  =  4.17, 
h  =  ”i(l  —  ^ii4)  +  >22(1  —  02a)  +  ”3(1  —  03a)  =  L83 . 


With  this  L,  the  solution  of  the  optimization  problem  o^  Theorem  5.3  is  k*  =  0.156  . 

The  behavior  of  the  network  with  Qk  defined  by  (5.49)  for  k  =  0.15  and  k  =  0.075  is  shown  in 
Figure  5.5.a  and  Fi^re  5.5.b,  respectively.  These  figures  were  obtained  by  a  numerical  solution 
of  equations  (5.16)-(5.18)  with  corresponding  Qk's,  The  results  can  be  summarized  as  follows: 
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RATE  (packets/slot)  BUFFER  (packets)  RATE  (packets/slot)  BUFFER  (packets) 


(a) .  Smaller  values  of  k  result  in  a  slower  response  and  larger  buffer  overshoot.  As  it  will  be 

discussed  below,  faster  response  and  smaller  buffer  overshoot  can  be  achieved  by  adopting 
smaller  update  periods.  Another  way  of  reducing  the  buffer  overshoot,  w'hich  is  not  dis¬ 
cussed  here,  is  to  impose  a  slow-start  on  connections  to  avoid  sharp  increases  in  the  input 
traffic. 

(b) .  When  the  traffic  is  heavy  (starting  at  time  t  =  100),  the  buffer  is  kept  at  x°  =  30,  with 

fluctuations  whenever  a  connection  is  initiated  (at  t  =100,  250,  400  and  550)  or  terminated 
(at  t  =  700  and  850). 

(c) .  When  the  input  traffic  changes,  the  rate  q{n)  converges  to  a  new  steady  state  where  the 

link  bandwidth  is  reallocated  in  order  to  accommodate  all  incoming  traffic  in  a  fair  way. 


5.4.3  Effect  of  the  update  period  T 

Controller  (5.49)  was  derived  for  the  update  period  Ti  =  60t,.  As  it  follows  from  Figure  5.5, 
this  T  results  in  quite  large  overshoot  and  slow  response.  It  might  seem  reasonable  to  decrease 
T  in  order  to  eliminate  these  problems.  According  to  the  theory  developed  in  Sections  3  and  4, 
this,  however,  is  not  the  c<ise:  the  utilization  of  a  controller  designed  for  a  larger  T  in  a  network 
with  smaller  T  may  bring  about  an  instability.  This  effect  is  illustrated  in  Figure  5.6.a  where  Qk 
of  (5.49)  with  k  =  0.15  is  used  when  T  is  chosen  to  be  T2  =  lOr,  instead  of  60r,.  Obviously,  the 
oscillatory  behavior  observed  is  unacceptable  in  most  applications. 

The  way  to  improve  the  speed  of  the  response  is  not  only  to  reduce  T  but  also  to  redesign 
the  controller  appropriately  (Theorems  5.1,  5.2,  and  5.3).  Specifically,  for  T2  =  IOt,,  repeating 
the  design  steps  described  above,  we  obtain 


Itqa  =  0 

=  ^  =  1.1 
fzA  =  2ua  =  2.2 
fax  =  3ti_4  =  3.3 


doA  =  0,  OoA  =  0 
<^14  =  2,  6ia  =  0.9 
<^24  =  3,  O2A  =  0.8 
dsA  =  4,  OsA  =  0.7 


do 

d\ 

d2 

dz 


0, 

4, 

6, 

8. 


Thus,  the  maximum  time  delay  D  is  equal  to  8  and  therefore 


Qk  =  {kao,kai,^Q,0i,...,^gf,  k  €  (0,  fc*). 


(5.50) 


where. 


and 

where. 


oo  =  2/3,  Qi  =  —5/9, 

/?o  =  4/3,  ^i=2/9,/?2  =  1/9, 

^3  =  0,  ^4  =  -1/9,  Ps  =  -2/9, 

^e  =  -l/3,  ^7  =  -4/9,/?8  =  -5/9, 

Jo  =  ”0(1  “  ^04)  =  4,  /i  =  0,  J2  =  0, 

I3  =  niOiA  =  2.7,  Ij  =  ni(l  —  9ia)  =  0.3, 

h  =  ^2^24  =  I'O,  h  =  «2(1  —  ^24)  =  0.4, 

h  =  nzOsA  =  0.7,  1%  =  123(1  —  Oza)  =  0.3 . 


The  solution  of  the  optimization  problem  gives  k*  =  0.160. 

Equations  (5.16)-(5.18)  with  T  =  lOr,  and  Qk  given  in  (5.50)  with  k  =  0.15  have  been  solved 
numerically.  The  results,  shown  in  Figure  5.6.b,  le€Mi  to  the  following  conclusions: 
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(a) .  Adopting  a  smaller  update  period  T  along  with  the  appropriate  controller  results  in  a  stable 

operation  of  the  network  with  faster  response  and  smaller  buffer  overshoot. 

(b) .  When  the  network  operates  with  a  controller  designed  for  larger  T,  an  instability  could  be 

brought  about  (see  Figure  5.6.a  where  large  oscillations  take  place  when  connection  5  is 
active). 

Note  that  the  total  simulation  time  (6OOOT2)  is  the  same  as  in  Figure  5.5  (lOOOTi )  since  T2  =  Ti/G. 

5.4.4  Adaptive  design 

In  this  section  we  design  an  adaptive  controller  for  both  update  periods  considered  above,  3'i 
and  72. 

In  the  case  of  T’l,  the  characteristic  polynomial  (5-35)  has  dimension  Z?  +  2  =  4  and 

therefore,  the  gains  are  specified  by  the  choice  of  4  desired  closed  loop  poles.  For  instance,  if  we 
choose  the  desired  characteristic  polynomial  as 

/^(A)  =  \\\  -  Ai)(A  -  A2),  Ai,2  =  0.4  ±  jO.3, 

then,  as  it  follows  from  (5.38),  the  adaptation  of  the  controller  gains  Q  =  {ao,ai,  ^2)^  fo 

changes  in  L  takes  the  following  form 

g(n)  =  [M(L(n-l))rf,  (5.51) 

where  . 

r  =  (1.2,  -0.75,  0,  0,  0)^. 

In  the  case  T2  =  IOt,,  we  choose  the  desired  behavior  according  to 
Pp(A)  =  A«(A  -  Ai)(A  -  A2),  Ai,2  =  0.4  ±  jO.3 . 

As  a  result,  Q  =  /3,)^  is  given  by 

Q(n)  =  lM(L(n-l))r'f,  (5.52) 

f  =  (1.2,  -0.75,  0,  0, ...,  0)^. 

Networks  with  controllers  (5.51)  and  (5.52)  have  been  simulated  by  a  numeric  solution  of 
equations  (5.26)-(5.27).  The  results  are  snown  in  Figure  5.7.a  and  Figure  5.7.b,  respectively. 
From  these  figures  we  conclude: 

(a) .  The  transient  behavior  of  the  network  under  adaptive  control  is  much  better  than  under 

robust  control. 

(b) .  Higher  updating  rates  result  in  faster  response  and  smaller  buffer  overshoot. 

(c) .  The  superior  performance  exhibited  by  the  adaptive  controller  justifies  its  selection  for 

implementation  despite  the  extra  computational  time  it  requires. 
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RATE  (packets/slot)  BUFFER  (packets)  RATE  (packcte/slot)  BUFFER  (packets) 


TIME  (slots)  TIME  (slots) 

Figure  5.8:  Random  input. 
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TIME  (slots)  TIME  (slots) 

Figure  5.9:  Congestion  recovery. 

5.4.5  Effect  of  random  traffic 

We  have  assumed  throughout  this  report  that  the  input  traffic  is  specified  by  a  constant 
rate  that  may  change  from  time  to  time  in  a  random  manner.  In  reality,  however,  the  input 
trafhc  is  random  in  the  sense  that  the  rate  rj  of  connection  t  is  a  random  number  r®(n).  In 
order  to  investigate  the  behavior  of  the  control  scheme  developed  in  this  report,  we  assume  that 
r°(n),  n  =  1, 2, . . .,  is  a  sequence  of  independent  random  variables  uniformly  distributed  over  the 
range  [(1  —  e)r{’,  (1  +  e)r®].  The  behavior  of  the  network  with  controller  (5.50)  and  k  =  0.15  is 
shown  in  Figure  5.8.a,  for  e  =  0.6,  and  Figure  5.8.b,  for  e  =  0.3.  The  results  can  be  summarized 
as  follows: 

(a) .  Due  to  the  structure  of  the  control  protocol  in  (5.17),  the  randonmess  will  not  appear  in 

the  state  trajectories  if  r°(n)  remains  greater  than  q{n)  for  all  active  connections  t.  This 
is  more  likely  to  happen  if  more  coimections  are  being  quenched  since,  as  it  follows  from 
(5.30),  the  steady  state  q  is  inversely  proportional  to  the  number  I  of  quenched  flows.  This 
is  the  reason  why  the  plots  in  Figure  5.8  exhibit  more  fluctuations  when  smaller  number 
of  connections  are  active. 

(b) .  During  the  time  intervals  when  the  randomness  in  the  input  is  reflected  in  the  dynamics, 

the  state  trajectories  fluctuate  but  remain  close  to  the  deterministic  trajectories  shown  in 
Figure  5.6.b. 

(c) .  As  the  level  of  randomness  increases,  i.e.,  as  e  gets  larger,  the  level  of  fluctuations  increases. 

5.4.6  Congestion  recovery 
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The  previous  simulations  dealt  with  congestion  prevention  where,  starting  from  an  empty 
network,  the  role  of  the  controller  is  to  prevent  congestion  from  taking  place.  In  this  final 
experiment,  we  examine  how  the  controller  ensures  recovery  from  congestion.  Under  the  same 
input  traffic  pattern  described  above,  we  operate  the  network  w  ithout  the  controller.  The  buffer, 
with  a  capacity  of  60  packets,  fills  up  and  overflows.  When  the  robust  controller  (5.50),  with  slot 
duration  T  =  T2  and  /:  =  0.15,  is  turned  on  at  time  t  =  2000721  we  obtain  the  dynamic  behavior 
shown  in  Figure  5. 9. a.  Figure  5.9.b  corresponds  to  the  case  where  the  adaptive  controller  (5.52) 
is  utilized.  From  these  figures  we  conclude  that 

(a) .  Both  the  robust  and  adaptive  controllers  are  capable  of  ensuring  congestion  recovery  under 

heavy  traffic  situations. 

(b) .  With  the  robust  controller,  the  node  recovers  from  congestion  in  about  80  timeslots  whereas 

a  much  faster  recovery  is  achieved  with  the  adaptive  controller. 
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6  SUMMARY  OF  THE  MOST  IMPORTANT  RESULTS  -  PART  2  : 
THE  CASE  OF  MULTIPLE  CONGESTED  NODES 


In  this  second  part  or  the  report  we  discuss  the  case  of  multiple  congested  nodes.  The  net¬ 
work,  the  input  traffic  and  the  control  architecture,  analyzed  here,  are  defined  as  follows  where 
most  of  the  assumptions  have  been  introduced  in  Part  1  and  are  restated  here  with  a  slight 
change  in  notation: 

The  network 


(i) .  The  network  employs  a  store- and- forward  datagram  service  where  users  are  serviced  without 

prior  reservation  of  resources. 

(ii) .  The  network  consists  of  S  switching  nodes  and  N  communication  links.  Let  S  =  {1,2,  ...,5} 

denote  the  set  of  nodes  and  =  {1,2,...,  N}  denote  the  set  of  links.  For  each  node  a  €  <5, 
let  0{a)  C  M  denote  the  set  of  its  outgoing  links  and  for  each  link  i  G  let  Si  be  the 
node  of  which  i  is  an  outgoing  link,  i.e.,  the  origin  node  of  link  i. 

(iii) .  Each  link  i  has  a  transmission  capacity  of  1/t,  packets/sec,  where  t,  is  the  transmission 

time  of  a  packet,  and  a  propagation  delay  of  t*  sec  which  depends  on  the  transmission 
medium  and  on  the  length  of  the  link.  We  assume  that  packets  have  the  same  fixed  size. 

(iv) .  Each  node  has  a  processing  capacity  of  I/t^,  packets/sec,  where  is  the  processing  time 

of  a  packet.  The  processing  capacity  of  each  node  is  assumed  to  be  larger  than  the  total 
transmission  capacity  of  its  incoming  links.  The  case  where  processing  is  the  bottleneck 
can  be  approached  similarly. 

(v) .  The  network  traffic  consists  of  flows  corresponding  to  each  source-destination  pair  (a6j, 

where  a  and  6  €  5.  The  pair  (o6)  will  be  referred  to  as  the  (o6)-type  traffic  or  the  (ao) 
connection.  Let  C  denote  the  set  of  all  such  connections. 

(vi) .  For  each  (a6)  connection,  the  source  at  node  a  sends  packets  to  the  destination  at  node  6 

through  a  sequence  of  links  referred  to  as  the  path  of  the  connection  and  denoted  p{ab). 
The  routing  policy  which  determines  the  path  of  each  connection  is  assumed  to  be  static. 
Let  C{i)  be  the  set  of  all  connections  (a6)  which  traverse  link  i  and  let  tab  denote  the  first 
link  in  the  path  of  connection  (a&). 

(vii) .  Each  node  has  a  buffer  for  storing  packets  waiting  to  be  transmitted  on  one  of  its  outgoing 
links.  Let  Xj,t  €  denote  the  number  of  packets  buffered  for  transmission  on  link  i  and 
referred  to  as  link  t’s  buffer. 

The  control  architecture 

(viii).  Each  node  a  has  a  congestion  controller  associated  with  each  outgoing  link  i  G  0(0- 

controller  periodically  computes  a  traffic  admission  rate  g,-  based  on  a  control  algorithm 
(see  below)  that  uses  local  information  to  node  a:  the  difference  between  x,  and  some 
threshold  x®  and  the  control  decision  g,-  at  present  and  in  the  finite  past.  The  threshold  x® 
is  introduced  to  insure  a  desired  bound  on  the  time  delay  in  the  steady  state  and  to  prevent 
congestion  or  underutilization  of  the  transmission  capacity  during  the  transient  periods  of 
control. 
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(ix) .  The  control  algorithm  updates  take  place  every  T  sec,  where  T  is  the  time  to  transmit 

c  packets  (T  =  cr,),  i.e.,  a  new  control  update  is  generated  after  every  c  packets  are 
transmitted.  Thus,  the  controller  time  is  slotted  with  the  slot  duration,  [n,n  +  1),  n  = 
0, 1, ... ,  equal  to  T.  Note  that  a  tradeoff  is  involved  in  the  choice  of  the  update  period  T 
since  shorter  T's  lead  to  better  responsiveness  to  changes  in  the  input  traffic  but  require 
the  processors  to  devote  more  time  updating  the  feedback  signals. 

(x) .  Each  node  sends  the  computed  control  information  (9,’s)  to  ^ue  sources  along  a  fixed  feed¬ 

back  path,  usually  the  reverse  direction  of  the  traffic  (assuming  bidirectional  links  which  is 
often  the  case).  This  control  information  is  serviced  with  high  priority  and  is  carried  either 
in  separate  packets  or  along  with  data  or  acknowledgment  packets.  The  sources  respond 
to  the  control  information  received  according  to  the  control  protocol  defined  below. 

The  input  traffic 


(xi) .  The  input  traffic  is  viewed  as  a  fluid  where  packet  boundaries  are  ignored.  This  fluid 

model  approximation  is  a  typical  assumption  in  the  analysis  of  dynamic  congestion  control 
mechanisms  [15]-[16]. 

(xii) .  For  each  connection  (a6),  let  r°(,  denote  the  rate  (in  packets  per  slot)  of  its  traffic  demand. 
We  assume  that  during  the  settling  time  of  the  system,  the  traffic  demand  is  constant  but 
otherwise  arbitrary  and  unknown.  This  assumption  could  be  understood  in  the  sense  that 
the  input  traffic  is  piecewise  constant  with  the  jumps  occurring  seldom  enough  so  that  the 
transients  of  the  system  have  time  to  settle  down  between  two  consecutive  jumps. 

System  (i)-(xii)  has  been  introduced  and  analyzed  in  Part  1  for  the  case  of  a  single  congested 
node.  Specifically,  Part  1  used  the  following  rate-based  control  algorithm  and  control  protocol: 


The  control  algorithm 

(xiii).  The  traffic  admission  rate  qi{n  -f  1)  calculated  by  link  i  at  time  n  is  given  by 

g,(n  +  1)  =  Sat,o  1 9,(n)  -  ^  a.j  (x<(n  -  j)  -  qi{n  -  fc)  |  ,  *  €  JV”,  (6.1) 

{  j=o  k=o  ) 

where  q°  >  c,  Oij  and  are  the  controller  gains,  J,-  and  Ki  are  non-negative  integers  and 


Sata(2:) 


0  if  z  <  0, 

•  a  if  z  >  a, 
z  otherwise  . 


The  control  protocol 

(xiv).  During  the  time  slot  [n,n  4-1),  the  (a6)-type  traffic  is  admitted  with  the  rate 

r<.6(n)  =  min  {g„.(n  -I- 1  -  d^^„),  m  G  p(a6);  r°  J  ,  (ab)  G  C,  (6.2) 

where  is  the  feedback  delay  of  connection  (ab)  with  respect  to  link  m.  When  the 
minimum  in  (6.2)  corresponds  to  the  admission  rate  of  link  j  G  p{ob),  connection  (ab)  is 
said  to  be  throttled  by  link  j. 
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(xv).  Traffic  at  each  link  is  serviced  according  to  the  First-Conie-First-Serve  (FCFS)  priority 
discipline. 

Unfortunately,  the  methods  developed  in  Part  1  do  not  seem  to  generalize  directly  to  the  case 
of  multiple  congested  nodes,  which  is  the  main  topic  of  this  part  of  the  report.  Two  indirect 
generalizations  are,  however,  possible.  The  first  one  is  based  on  a  modification  of  the  FCFS 
priority  scheme  and  the  second  on  the  assumption  that  the  control  update  period  is  large.  This 
part  of  the  report  is  devoted  to  the  former  case.  Specifically,  assume  that; 

(xv').  Traffic  at  each  link  is  transmitted  according  to  the  Remote-Throttled-First-Serve  (RTFS) 
priority  discipline;  Each  link  i  first  transmits  traffic  of  connections  not  throttled  by  itself 
including  traffic  not  throttled  at  all.  When  no  such  traffic  is  waiting  for  service,  it  starts 
transmitting  traffic  of  connections  throttled  by  itself.  Connections  within  each  of  the  two 
categories  (throttled  and  nonthrottled  by  link  i)  are  serviced  on  a  first-come-first-serve 
basis.  To  implement  this  strategy,  each  packet  carries  a  stamp  identifying  the  throttling 
link  of  the  connection  it  belongs  to. 

Given  this  discipline,  this  report  presents  a  method  for  choosing  the  gains,  and  /?■*,  for 
each  link  i  E  jV,  which  result  in  a  controller  that  prevents  network  congestion.  Moreover,  we 
show  by  simulations  that  the  same  gains  ensure  a  congestion-free  stable  operation  of  the  network 
under  the  FCFS  strategy.  This  result,  however,  is  not  proved  analytically. 


6.1  EVOLUTION  EQUATIONS 

6.1.1  Preliminaries 

Let  ^“‘(n)  denote  the  amount  of  (a6)-type  traffic  at  the  buffer  of  link  i  at  time  n.  Let  V’“*(^) 
and  V’“-(n)  denote  the  rate  at  which  the  (a6)-type  traffic  is  transmitted  on  link  i  and  on  the 
link  that  precedes  link  i  along  the  path  of  connection  (a6),  respectively,  during  the  time  slot 
[n,n  +1).  Note  that,  in  terms  of  this  notation,  ^“-{n)  is  equal  to  rab{n)  if  link  i  is  the  first  link 
in  the  path  of  connection  (a6),  i.e.,  V**-  («)  =  rab{n).  Then,  the  evolution  of  the  system  defined 
by  assumptions  (i)-(xiv)  is  described  by  the  following  equations; 

x“‘(r.  +  1)  =  !••(»)  +  -  r??)  -  (6.3) 

?j(n  +  1)  =  Sat,.  I  ?,(ti)  -  2  a,v  (i,(n  -  j)  -  x“)  -  ft,  ?i(n  -  t)  I ,  (6.4) 

t  j=0  fc=o  J 

(n)  =  r„j(n)  =  min  {q^in  +  1  -  m  €  p(a6);  r®  J  ,  f  G  AT,  {ab)  E  (7(0,  (6.5) 

where  is  the  one-hop  delay  for  the  link  that  precedes  link  i  on  the  path  of  connection  (ai), 

is  the  feedback  delay  of  connection  (ab)  with  respect  to  link  m,  and  a,j  and  are,  as  before, 

the  controller  gains  associated  with  link  t.  We  use  the  following  notations  for  time  delays: 

:  feedback  delay  from  node  Si  to  node  a, 
t“*  :  forward  delay  from  node  a  to  node  s,-, 

T,“*  :  forward  delay  from  node  s,  to  node  Sj, 

-f  r“j’  :  round  trip  delay  from  node  s,  to  node  Sj, 
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where  [r]  denotes  the  smallest  integer  greater  or  equal  to  c:.  The  forward  (feedback)  delay  from 
node  oi  to  node  02  is  equal  to  the  sum  of  the  one-hop  delays  of  all  links  between  node  oj  and 
node  02  in  the  forward  (feedback)  path  of  connection  (ab).  The  one-hop  delay  for  link  i  is  defined 
eis  the  sum  of  the  packet  transmission  delay  at  the  origin  node  of  link  i,  the  propagation  delay 
on  link  i,  and  the  packet  processing  delay  at  the  destination  node  of  link  i,  all  expressed  in  time 
slots  T,  i.e., 


The  feedback  delay  in  (6.5)  is  equal  to  since,  due  to  the  fact  that  qm  is  generated  every 

T,  the  most  recent  feedback  information  available  at  node  a  at  time  n  is  qm{Ti  +  1  —  d^^). 

Equations  (6.3)-(6.5)  are  not  closed  with  respect  to  the  unknowns  since  is  not  expressed 
in  terms  of  the  states  x®**  and  g,  and  the  demands  They  can  be  made  closed  under  the  FCFS 
discipline  since,  in  this  case,  0f*’(n)  can  be  modeled  as 


'’(n)  =  min  |xf(n), 


where  i,  =  IZ(ai)6C(i)  *s  the  total  occupancy  of  the  buffer  of  link  i.  However,  the  substitution 
of  this  expression  in  (6.3)  results  in  a  system  that  seems  to  be  impossible  to  analyze.  Even  the 
linearized  form  of  these  equations  seem  to  be  too  complex  for  analytical  investigation  due  to  its 
high  dimensionality  and  linearized  dynamics  complexity.  These  difficulties  are  avoided  when  the 
RTFS  discipline,  introduced  in  (xv'),  is  used.  However,  under  this  priority  discipline,  equations 
(6.3)-(6.5)  cannot  be  made  closed  since  does  not  admit  a  simple  representation.  Therefore, 
we  proceed  as  follows:  First,  we  consider  the  steady  state  form  of  (6.3)-(6.5)  which  allows  us  to 
determine  the  steady  state  values  of  x,  and  qi  irrespective  of  the  priority  aiscipline.  Then,  we 
show  that,  in  some  neighborhood  of  this  steady  state,  the  dynamic  equations  of  only  a  subset 
of  the  network  links  deviate  from  the  steady  state,  and  the  consideration  of  only  this  subset  is 
sufficient  for  the  network  analysis.  This  subset  is  referred  to  as  the  bottleneck  subnetwork. 
Finally,  we  show  that,  under  the  RTFS  discipline,  a  closed  form  expression  for  tpf  can  be 
derived  and,  due  to  the  resulting  decoupling  of  the  dynamics,  we  show  that  it  is  sufficient  to 
consider  the  dynamic  equations  for  x,-  and  qi  only,  without  involving  the  buffer  occupancies  x“*’. 
The  bottleneck  subnetwork  is  introduced  below  followed  by  the  derivation  of  the  local  dynamic 
equations. 

6.1.2  The  bottleneck  subnetwork 

The  balance  equation  for  x,(n),  derived  from  (6.3),  is 

x,(n  +  1)  =  x,(n)  -f  fi{n)  -  i  €  J^,  (6.7) 

where 

«")=  E 

is  the  aggregate  input  flow  to  link  t,  and 

V'i(n)  = 

(a6)ec(0 

is  the  total  transmission  rate  of  link  i  during  [n,n  +  1).  This  rate  is  equal  to  the  link  capacity  c 
as  long  as  the  buffer  is  not  empty.  Therefore,  (6.7)  is  equivalent  to 

Xi{n  +  1)  =  sg{i,(n)  -f  /,(n)  -  c},  i  €  jV',  (6.8) 
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where 


''  ^0  otherwise. 


Let  z  denote  the  steady  state  value  of  z{n).  Then,  (6.3)-(6.5)  and  (6.8)  imply,  respectively. 


Tab  jab 

'Pi-  =  'Pi  , 


Qi  =  Sat,o  I?-  -  j  (^*  -  ^°)  “  j  9. 

=  Tab  =  min  {9,„,m  G  p{ab);  , 

Xi  =  sg {i,  +  fi-c},  ieM,  {ab)  €  C{i). 


(6.10) 

(6.11) 

(6.12) 


Equations  (6.9)  and  (6.11)  imply  that 


Therefore, 


V’f  =  ''ab,  (ab)  eC,  i  6  p{ab). 

fi=  1C  ^ 

(a6)ec(i)  {ab)€C{i)  (<«6)6C(.) 


Let  Cim  be  the  set  of  connections  in  C{i)  that  are  throttled  by  link  m  and  let  Im  be  its  cardinality. 

Let  CiQ  be  the  set  of  connections  in  C(t)  that  are  not  throttled  by  any  link.  Then,  if  we  assume 
.  1 


9m  7^  9n  ^  f'ab,  («^)  €  C,  m,n  6  p(ab),  m  #  n, 
then  Cim.  t  =  1,2, ,  JV, m  =  0, 1,..  .,1V,  are  uniquely  dehned  and  we  have 


(6.13) 


JV 

/«■  =  ^  d"  ^i  » 


(6.14) 


where  r®  =  ]C(o6)eCio  Is  the  cumulative  rate  of  nonthrottled  connections  in  C(i).  We  adopt 
the  following  assumption  about  the  input  traffic  which  is  less  conservative  than  (6.13): 

V(ab)  €  C(t) :  if  min{?„„  m  €  p(ab), r°J  =  g„,  then  g„  ^  r°j,  9n  9m. ^  P(o^)> 

if  min{9,„,  m  G  p(ab),  r®  J  =  r®>,  then  r®j  ^  m  G  p(ab).  (6.15) 

This  assumption  is  used  below  to  linearize  the  system  in  the  vicinity  of  its  steady  state  since  the 
function  h(g)  =  min{g,  a}  is  not  differentiable  at  g  =  a. 

Obviously,  the  steady  state  flow  /,•  in  (6.14)  can  be  either  smaller  or  larger  than  the  link 
capacity  c.  If  /,  <  c,  then  (6.12)  implies  that  x,  =  0.  In  addition,  since,  as  it  is  shown  below, 
the  controller  gains  must  satisfy,  among  others,  the  following  requirements: 

5^  Oij  >  0  and  ii9,fc  =  0  ,  t  €  (6.16) 

j=o  k=o 


it  follows  from  (6.10)  that  g^  =  g®.  Therefore,  any  link  i  with  steady  state  flow  less  than 
its  capacity  (underloaded  link)  has  its  buffer  at  zero  and  its  control  signal  saturated  at  g®. 


Furthermore,  since  /,  =  ^ijQj  +  9i  =  9°  >  c,  and  /„  is  a  nonnegative  integer,  we 

conclude  that  =  0  (and  as  a  result  /j,  =  0,  j  €  Af  )  for  all  underloaded  links. 

On  the  other  hand,  if  >  c,  then  (6.12)  implies  that  /,  =  c.  When  /,  =  c  and  >  0,  the 
link  is  said  to  be  overloaded.  There  may  exist  a  link  i  with  f,  =  c  but  /„  =  0.  Such  a  link  is 
neither  overloaded  nor  underloaded  since  the  steady  state  flow  is  equal  to  the  link  capacity  but 
no  traffic  is  throttled.  We  assume  that  no  link  operates  in  this  regime.  For  overloaded  links, 
since  /,  =  c  and  /,,  >  0,  (6.14)  implies  that  0  <  9,  <  c  <  and  therefore,  (6.10)  gives 


-  _  0  0ik 

x,  =  x-  - 9,. 


In  order  to  achieve  Xi  =  x^,  we  impose  the  constraint 


E  h  =  O- 


it=0 


(6.17) 


Let  Afi  and  denote  the  sets  of  overloaded  and  underloaded  links,  respectively,  with  Af  = 
Ml  U  M2-  Assume,  without  loss  of  generality,  that  M\  =  {1, 2, . . . ,  Ai},  N\  <  N.  Then,  in  the 
neighborhood  of  the  steady  state,  /i(n)  <  c,  t  6  M2,  since  /,  <  c  and  /i(n)  is  a  continuous 
function  of  the  network  state  (see  Lemma  6.2  below).  This  implies  that,  in  that  neighborhood, 
Xi{n)  and  9i(n)  do  not  deviate  from  their  steady  state  values  Xj  =  0  and  9,  =  9°,  and  as  a  result, 
no  queueing  delay  is  experienced  at  buffers  of  underloaded  links.  Therefore,  for  the  local  analysis, 
it  suffices  to  consider  the  bottleneck  subnetwork  consisting  of  all  links  i  €  Mi. 


6.1.3  Local  dynamic  equations 

As  it  follows  from  the  previous  subsection,  the  steady  state  flow  through  an  overloaded  link 
i  is  given  by 

fi  =  ^hiqj-\-r^,ieMi, 

j=i 


or  in  matrix  notation 

F  =  AQ-f/2°,  (6.18) 

where  F,  Q,  and  BP  are  JVi -dimensional  vectors  with  the  i-th  entry  being  /j,  9,,  and  r®,  re¬ 
spectively,  and  A  is  the  Ni  x  Wj-matrix  of  the  /j,’s  with  positive  diagonal  entries  la's.  In  this 
subsection,  we  derive  an  expression  of  the  flow  F{n)  in  the  neighborhood  of  its  steady  state  value 
F. 

Lemma  6.1  Under  the  control  protocol  introduced  in  assumption  (xiv),  A  is  an  essentially  trian¬ 
gular  matrix,  i.e.,  there  exists  a  relabeling  of  qi,  t  =  1, 2, . . . ,  Ni,  that  results  in  A  being  triangular. 

□ 


Proof:  See  Appendix  3. 

Assume  that  the  links  have  been  relabeled  in  such  a  way  that  A  is  a  lower  triangular  matrix. 
Therefore, 

/.  =  E  'iiS;  +  ’•?  =  E  4  +  =  4  +  h,  (619) 

J=1 
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where  f-  =  lijq^  is  the  steady  state  contribution  to  the  flow  of  link  i  by  the  traffic  throttled 

by  link  j  and  J-n  =  f,  —  fa  corresponds  to  traffic  which  is  not  throttled  by  link  i.  Let  the 
vector  Yiin)  denote  the  state  of  link  i  at  time  n  consisting  of  the  admission  rate  q,  and  buffer 
occupancies  i“*”s  at  present  and  in  the  finite  past.  The  exact  form  of  Y,{n)  will  be  given  below. 

Lemma  6.2  Under  the  RTFS  priority  discipline  introduced  in  assumption  (xd),  there  exists  a 
neighborhood  B  of  the  steady  state  where  the  link  flow,  fi{n),  is  given  by 

Mn)  =  /..(«)  +  Mn),  i  eAfi  , 

where 

/i.(")=  E  9.("  +  1  -  (6-2l>) 

(ai)€C„ 

and  fii{n)  is  a  function  of  the  states  Yfln)  of  links  j,  j  =  1,2,..  .  .i  —  1.  Moreover,  /,(n),  i  6  Af, 
depends  continuously  on  the  network  state.  □ 

Proof:  See  Appendix  3. 

Since  the  rates  are  constant  during  any  time  slot  [n,  n  +  1),  when  the  delay  t  is  not  an  integer, 
we  rewrite  q(n  —  t),  which  represents  the  rate  during  [n  —  t,  n  1  —  r),  as 

9(n  -  t)  =  (1  -  d)  q(n  -  d)  +  0  q(n  +  1  -  d),  (6.21 ) 

where  d  =  fr] ,  the  smallest  integer  greater  or  equal  to  r,  and  0  =  [t]  —  t  is  in  the  interval  [0,1). 
Using  transformation  (6.21),  equation  (6.20)  becomes 

Mn)  =  E  ‘Ni(n  +  1  -  t),  (6.22) 

k=0 

where 

'.*=  E  E 

Cj  =  {(o6)  €  C„  :  [<*]  =  t}  , 

Here,  /f  is  the  equivalent  number  of  connections  throttled  by  link  i  with  round  trip  delay  equal 
to  k  satisfying  I3f=o  A'  is  the  largest  round  trip  delay  for  all  connections  having  link 

i  in  their  path.  Note  that  the  sets  C,--  may  not  remain  constant  outside  the  neighborhood  B  and 
therefore  is  generally  a  function  of  time  (/*(n)j. 

Since,  as  it  is  shown  before,  the  steady  state  values  of  a:,(n)  and  q,(n),  i  €  Afi,  satisfy 
Xi  =  x°  >  0  and  0  <  9,-  <  q°,  the  saturation-type  nonlinearities  in  (6.4)  and  (6.8)  are  not 
activated  in  the  neighborhood  B  of  the  steady  state  where  x,-  >  0  and  0  <  <  q°.  Therefore, 

the  network  dynamics  is  described  in  Bo  =  S  fl  B  by  the  equations 

x,(n  -fl)  =  x.(n)  -H  /,(n)  -  c, 

./i  /f. 

9,(n  -f- 1)  =  9<(n)  -  ^  Oij  [xi{n  -  j)  g,(n  -  fc),  i  €  A^i, 

i=o  fc=o 
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where  ft{n)  is  given  in  Lemma  6.2.  The  analysis  of  these  equations  is  described  in  the  next 
section  where  a  method  of  choosing  the  gains  a^’s  and  /3j^’s  is  piesented. 


6.2  ANALYSIS 

6.2.1  The  decoupling  property 

As  it  follows  from  the  previous  section,  the  local  (i.e.,  in  the  neighborhood  Bq  of  the  steady 
state)  closed  loop  behavior  of  the  network  under  the  RTFS  priority  scheme  is  described  by  the 
following  equations: 

D. 

Xi(n  +  1)  =  a:i(n)  +  +  1  “  ^)  +  /n(n)  -c,  (6.24) 

*=0 

J,  K, 

qi{n  +  1)  =  qi{n)  -  ^  (xi(n  -  j)  -x°)  9,(n  -  A:),  i  €  .  (6.25) 

J=:0  t=0 

Theorem  6.1  Under  assumptions  (i)-(xiv)  and  (xd),  equations  (6.24)-(6.25)  are  decoupled  in 
the  following  sense:  System  (6.24)-(6.25j  is  asymptotically  stable  if  and  only  if  each  of  the 
following  Ni  independent  pairs  of  equations  which  corresponds  to  a  separate  link  is  asymptotically 
stable: 


x,(n+l)  = 


9,(n4-l)  = 


Proof:  See  Appendix  4. 

Note  that  such  a  decoupling  is  not  possible  under  the  FCFS  priority  discipline  due  to  the 
interaction  among  all  traffic  types  queued  for  transmission.  The  RTFS  discipline  limits  such 
interaction  by  giving  priority  to  nonthrottled  traffic. 

It  follows  from  Theorem  6.1  that  the  design  of  the  network  controller  can  be  accomplished 
by  designing  a  controller  for  each  link  separately  without  regard  to  the  others.  In  other  words, 
Theorem  6.1  reduces  the  solution  of  the  multiple  congest^  node  case  to  that  of  the  single 
congested  node  case.  The  problem  of  analysis  and  design  for  the  single  congested  node  case  has 
been  carried  out  in  Part  1.  The  main  results  will  be  presented  here  without  proofs  and  the  reader 
is  referred  to  Part  1  for  the  complete  derivations. 

Note  that,  since  (6.24)  involves  delayed  versions  of  9,(n)  up  to  qi{n  —  (D,-  —  1)),  it  is  natural 
to  assume  that  Ki  >  Di  —  1  and,  as  a  result,  we  choose  the  network  state  Y (n)  as 

Kfr.)  =  (Ki(n) Yi(n)  ...Yk, (n)f ,  (6.28) 

where 

Y(n)  =  ^Xj(n)  z  ,  x,'(n  1)  x  ,..., Xi^n  Jf)  x  ,  qi{n)^  9i(^  !)»•••» 

The  steady  states  and  dynamic  properties  of  the  network  are  described  below. 


S li  qi{n  +  l-k)-c,  (6.26) 

k=zO 

9.(w)  -  S  (**("  ”  j)  “  “  li  ^ik  9»(”  -  (6-27) 

J=0  fc=0 


V  i  €  ATi . 
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6.2.2  Steady  states 

As  it  follows  from  the  previous  section,  the  steady  state  flew  through  any  overloaded  link  i, 
/,  =  +  r°,  is  equal  to  the  link  capacity  c  and,  under  constraint  (6.17),  the  steady  state 

buffer  occupancy  Xi  is  equal  to 

Using  fhe  notation  in  (6.18),  the  steady  state  flow  can  be  written  in  matrix  form  tis 

F  =  AQ+  =  C, 

where  C  is  the  A^i- dimensional  vector  with  entries  equal  to  c.  Being  lower  triangular  with  positive 
diagonal  elements,  A  is  nonsingular  and  therefore 

g  =  A'*  (C  -  7?®)  .  (6.29) 

Thus,  under  constraint  (6.17),  the  unique  steady  state  is  characterized  by  the  steady  state  buffer 
occupancies  ij  =  1°,  i  €  Mi,  and  the  steady  state  rates  Q  =  A“*  {C  —  R°).  The  fairness  property 
of  these  steady  state  rates  is  presented  below. 

In  allocating  the  network  resources  among  the  competing  connections,  one  of  the  objectives 
is  to  maximize  the  network  utilization  while  achieving  some  fairness  in  resource  allocation.  An 
intuitive  notion  of  fairness  is  that  any  connection  is  entitled  to  as  much  network  use  as  any  other 
connection,  irrespective  to  the  geographical  separation  of  the  connection’s  origin  and  destination. 
Since  connections  follow  different  paths  and  therefore  links  are  traversed  by  different  numbers  of 
connections,  this  intuitive  notion  leads  to  the  max-min  fairness  [24]  described  below. 

We  start  by  describing  some  terms.  An  allocation  r  is  a  function  that  <issigns  each  connection 
(ab)  a  rate  Vab.  The  allocation  is  feasible  if  it  is  consistent  with  the  demand  r°(,  and  the  link 
capacities,  i.e., 

0  <  Tai  <  (ab)  e  C, 

ft  =  rab<c,  i  eM 

(afc)6C(.) 

A  feasible  allocation  r  is  max-min  fair  if  for  each  connection  (ab)  and  feasible  allocation  r'  for 
which  r'j,  >  ra6,  there  exists  a  connection  a'b'  with  ra>b>  <  r^b  ana  <  Va'b'-  In  other  words, 
r  is  max-min  fair  if  for  every  connection  (ab)  €  C,  Tab  cannot  be  increaised,  while  maintaining 
feasibility,  without  decreasing  ra'b'  for  some  connection  a'b'  for  which  ra>b>  <  rab- 

The  term  “max-min  fair  allocation”  comes  from  the  fact  that  for  such  a  strategy,  the  smallest 
rate  assigned  to  any  connection  is  as  large  as  possible  and,  subject  to  this  constraint,  the  second 
smallest  assigned  rate  is  as  large  as  possible,  etc.  Each  of  these  nested  max-min  optimization 
problems  can  be  formulated  as  a  linear  programming  problem  and  it  can  be  shown  that  there 
exists  a  unique  allocation  that  solves  them  [24]. 

Theorem  6.2  The  allocation  resulting  from  the  steady  state  rates  (6.29)  is  max-min  fair.  □ 
Proof:  See  Appendix  4, 

6.2.3  IVansient  analysis 

As  it  follows  from  the  decoupling  property,  the  local  dynamics  of  link  t  is  given  by 

Di 

x,(n  -f  1)  =  x,(n)  -I-  I'lqfji  -1- 1  -  fc)  +  /-(n)  -  c,  (6.32) 

fc=0 

J,  K, 

qi(n  -I- 1)  =  9.(n)  -  aij(xi(n  -  j)  -  x“)  -  $7  A.fc9.(«  “  k) ,  (6.33) 

3=0  k  -o 

where  the  effect  of  the  other  links  reduces  to  a  disturbance  fii(n). 


(6.30) 

(6.31) 
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Theorem  6.3  For  given  /°,  1],  ...,/P',  the  poles  of  the  system  (6.32)~(6.SS)  can  be  placed  ar¬ 
bitrarily  by  an  appropriate  choice  of  the  gains  o^o,  •  •  • ,  oiu, »  /^iO)  •  •  •  >  ^iK,  >  I3fc=0  ^ik  —  0,  if  Ji  —  I 
and  Ki  =  A.  □ 

Proof:  See  Part  1. 

Thus,  a  PD  controller  with  respect  to  Xi  and  a  controller  of  order  A  with  respect  to  are 
sufficient  to  ensure  any  desired  dynamics  or  the  closed  loop  system  (6.32)- (6.33). 

As  it  follows  from  the  proof  in  Part  1,  the  characteristic  polynomial  of  the  closed  loop  system 
can  be  represented  as 

fi(A)  =  (-1)'>'*'A/V.(A), 

where  „  „  . 


/V.(A)  =  -h  7.iA^‘'''  +  liX'  +  . . .  +  7i.D.+2, 

/  \T  .  .  . 


(6.34) 


and  the  vector  of  coefficients  P,  =  (7,1  7^2  ...  7,,i5,+2)  is  related  to  the  controller  gains  as 
follows: 

A  =  M(A)A,  (6.35) 

where 


7.1+2 
7i2-  1 
7.3 


7i,Dj+2 

0 


( 

0  1 

\ 

11 

/?  -1 

1 

11 

1] 

1  ••• 

,A/(Li)  = 

• 

; 

1 

/P‘ 

iDi-l 

*i 

-1  I 

0 

If^ 

-1 

f 

0 

0  1 

1  ...  1  / 

,  Li  = 


and  G.  =  (a,oa<i  . . .  fiio.Y ■  Therefore,  as  it  follows  from  (6.34),  one  of  the  closed  loop 

poles  is  at  0  and  the  remaining  A  +  2  poles  can  be  chosen  at  will.  Indeed,  for  any  desired  set  of 
coefficients  7jj,  j  =  1, 2, . . . ,  A  -|-  2,  the  corresponding  control  gain  G<  is  obtained  from  (6.35)  as 


Gi  = 


(6.36) 


since  M{Li)  is  shown  to  be  a  nonsingular  matrix  with  determinant  equal  to 

Expression  (6.35)  can  be  rewritten  in  the  following  alternative  form  which  is  used  below  for 
design  purposes: 

Ti  =  Tip  +  WiaLi,  (6.37) 


where 


Ti0  = 


^0  -  2 
^.1  -  ^<0  +  1 
^.2  ~  ^.1 
^i3  ~  Pi2 


OtiO 

Oil  ttiO 


Wia  =  {yioVi^...ViD,)  = 


PiDi  ~ 

~^iDi 
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Concluding  this  section,  we  note  that  the  sum  of  the  coefficients  of  1  + 

is  equal  to  (a,o  +  ou)  Since  it  is  necessary  for  asymptotic  stability  that  this  sum  be 

positive,  a,o  +  au  has  to  be  positive  as  stated  in  (6.16). 

The  next  section  presents  ways  of  choosing  the  vectors  of  control  gains  Gi,  i  6  A/’. 


6.3  DESIGN 

6.3.1  Adaptive  vs.  robust  design 

The  design  of  the  congestion  controller  involves  the  computation  of  the  parameters  of  the 
control  law,  i.e.,  the  vector  of  control  gains  Gi  =  ^a,o o.i /9,o ...  As  it 

has  been  shown  in  Section  3,  the  closed  loop  dynamics  depend  on  the  number  of  throttled 
connections  Li  =  (/®/l  ...  ,  where  is  the  equivalent  number  of  throttled  connections 

with  round  trip  delay  equal  to  k.  Therefore,  if  each  link  i  can  take  into  account  the  variations  of 
Li  when  computing  the  control  law,  the  resulting  design  is  referred  to  as  adaptive;  here  G,  is 
updated  whenever  L,  changes.  If  information  about  L,  is  not  available,  a  robust  design  has  to  be 
considered;  here  the  control  law  is  implemented  with  a  fixed  G,-  so  that  stability  and  performance 
requirements  are  satisfied  for  all  admissible  values  of  Li- 

Note  that  an  adaptive  design  has  the  advantage  of  achieving  good  performance  but  at  the 
expense  of  higher  computational  requirements  (the  updating  algorithm  for  G,)  whereas  a  robust 
design  requires  less  computations  but  the  achieved  performance  may  be  inferior.  Each  of  these 
design  approaches  are  investigated  below. 

6.3.2  Adaptive  design 

Suppose  that  the  desired  performance  of  the  congestion  control  system  is  specified  in  terms 
of  closed  loop  poles  that  correspond  to  the  vector  of  characteristic  polynomial  coeflBcients  F,-  = 
{liilii  •  •  •  '  Then,  as  it  follows  from  (6.36),  the  adaptation  of  the  control  gain  G,-  to 

changes  in  L,-  takes  the  following  form: 

G.(n)  =  [M (L.(n  -  l))]-'f .• ,  (6.38) 

where  L,(n)  =  Hi{n)l}{n)  ...  /f‘(n))^  andf,-  =  (7,1  +  2,  7<2-l»  7<3>  •  •  •  .7<,Di+2>  0)^*  Note  that 
G,(n)  depends  on  Li  at  time  n  —  1  since  at  time  n  only  L,(n  —  1)  is  available.  Also,  in  order  to 
be  able  to  implement  an  adaptive  design,  the  congestion  control  protocol  should  be  implemented 
in  such  a  way  that  Li  can  be  known  to  the  switching  nodes.  One  way  of  doing  so  is  to  stamp 
each  packet  with  the  identity  of  the  throttling  link,  if  any.  In  this  way,  every  node  can  maintain 
a  table  of  throttled  connections.  The  performance  of  the  network  utilizing  the  adaptive  control 
law  (6.38)  is  illustrated  in  Section  5  below. 

6.3.3  Robust  design 

The  goal  of  this  subsection  is  to  find  a  fixed  gain  G,-  =  (a,o  a,i  fin  . .  •  ^io- that  ensures 
stability  of  the  closed  loop  system  (6.32)-(6.33)  for  all  values  of  Li  belonging  to  an  admissible 
set  £,  defined  as 

£,i  =  (I^,’o  X  ^ii  X  ...  X  C’iDi)  {®}>  ^ik  —  [0,  ],  A;  =  0, 1, ... ,  D,-,  (6.39) 

where  is  the  maximum  equivalent  number  of  throttled  connections  with  round  trip  delay  equal 
to  k.  Tne  solution  of  this  problem  is  given  by  the  following  two  theorems: 


38 


Theorem  6.4  There  exists  a  positive  number  k*{Li)  where  Li  =  (/” /,  ...  /,  ')^  such  that  the 
closed  loop  system  (6.S2)-(6.33)  is  asymptotically  stable  for  any  Li  €  £,  if  the  control  gains  are 
chosen  as 

Gi  =  (fc,aio  kian  0iQ^n  ...  ^io,)^ ,  h  e  (0,**), 

where 


CtiO 


^iO 


A +  4 
2(A  + 1)  ’ 

A +  2 
2(A  +  1)  ’ 

Wi 

2(A  +  1)’ 
A-2(ib  +  l) 
2(A  + 1) 


*  =  1,2,...,A 


□ 


Proof:  See  Part  1. 


Thus  the  robust  control  gain,  A,  is  the  (A  +  3)-dimensional  vector  with  components  defined 
in  Theorem  6.4. 

Let  Sg  be  the  surface  in  defined  by  the  equations 

,..1  Egr7icos0«)  =  -1, 

'  '  I  EjitSj  SiBO®)  =  0,  »  €  (0,ir), 

and  let  the  inequality  L,  <  L,  imply  the  component  wise  inequalities  /f  <  /*',  A;  =  0, 1, . . . ,  A. 
Theorem  6.5  The  positive  number  k*,  referred  to  in  Theorem  4-1  >  ^  defined  as 

k*  —  rmn{k},  k^}. 


Here, 


k]  = 


3A  +  5-K-l)^HA-f-3) 


2(A+3)Ei2/'^/?"  ’ 

and  kj  is  the  solution  of  the  following  optimization  problem: 

minimize  k  subject  to  the  constraints 


(6.40) 


it  >0, 

r,7J  +  WiaLi  €  5'J, 
0  <  Li  <  JbLi, 


where  Tig  and  Wia  are  defined  in  (6.87).  If  the  solution  of  this  optimization  problem  does  not 
exist,  kf  =  +00.  □ 

Proof:  See  Part  1. 

Thus,  the  design  of  the  robust  congestion  controller  can  be  accomplished  in  two  stages.  First, 
the  optimization  problem  of  Theorem  6.5  is  solved  and  k^  is  determined.  At  the  second  stage, 
a  specific  gain  A  is  chosen  from  the  family  defined  in  Theorem  6.4  so  that  the  performance 
requirements  are  satisfied  as  much  as  possible.  This  design  procedure  is  illustrated  in  the  next 
section. 
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Figure  6.1:  Network  topology. 


Connection  ^  |  initiated  at  time  j  terminated  at  time  ]  input  rate  (xc) 


Table  6.1:  Network  load. 


6.4  DESIGN  EXAMPLE  AND  NUMERICAL  SIMULATIONS 

6.4.1  Preliminaries 

This  section  presents  a  design  example  and  simulation  results  Although  the  theoretical 
results  presented  in  this  second  part  of  the  report  refer  exclusively  to  RTFS  priority  discipline, 
the  simulations,  described  below,  have  been  carried  out  for  both  RTFS  and  FCFS  schemes.  The 
reason  for  presenting  the  FCFS  results  is  two  fold.  First  the  RTFS  priority  exhibits,  in  some 
re^mes,  undesirable  oscillations  not  revealed  by  the  local  analysis;  therefore,  some  remedy  to 
this  phenomenon  is  desirable.  Second,  although  we  were  unable  to  investigate  the  FCFS  case 
analytically,  it  turns  out  that,  as  it  is  illustrated  by  the  simulation  described  below,  it  does  indeed 
offer  the  remedy  to  the  problem  at  hand.  In  other  words,  we  show  below  that  the  congestion 
controller,  designed  for  the  RTFS  discipline,  works  well  if  the  FCFS  priority  is  used.  Moreover, 
the  dynamic  performance  of  the  latter  is  better  than  the  former  in  the  sense  that  FCFS  produces 
no  undesirable  nonlinear  oscillations. 

The  robust  and  adaptive  designs  for  both  the  RTFS  and  FCFS  disciplines  are  presented 
below.  We  begin  by  describing  the  simulated  network  and  the  activity  of  the  input  tri^c. 

6.4.2  The  network  and  the  input  traffic 

Consider  a  seven-node  network  shown  in  Figure  6.1.  The  links  are  identical  with  bidirectional 
channels  having  a  delay-bandwidth  product  of  10  packets,  i.e.,  the  propagation  delay  over  a  link 
corresponds  to  the  time  for  transmitting  10  packets.  This  is  the  case,  for  instance,  of  45  Mbps 
channels  when  1  kbyte  packets  are  sent  over  a  340-mile  link.  The  activity  of  the  six  labeled 


connections  in  Figure  6.1  is  shown  in  Table  6.1  for  a  duration  of  3000  time  slots  T  where  T  is 
equal  to  10  r,  (equal  to  1.8  msec  for  the  case  of  45  Mbps  links  with  1  Kbyte  packets).  This  choice 
of  T  corresponds  to  one  control  update  every  10  transmitted  packets.  The  set  point  for  buffers 
is  chosen  as  =  30  packets. 

The  activity  of  the  input  traffic,  as  shown  in  Table  6.1,  is  such  that  only  links  1,  2,  and  3  (from 
node  1  to  2,  2  to  3,  and  3  to  4,  respectively),  will  become  overloaded  and  therefore,  only  the  states 
of  these  links  need  to  be  monitored  during  the  simulation.  Note  that,  although  the  simulation 
involves  only  6  connections,  the  fact  that  the  network  can  carry  up  to  42  connections  (one  for 
each  source-destination  pair  of  nodes)  is  taken  into  account  in  the  design  of  the  controller. 

Assume  a  balanced  minimum-hop  routing  policy  where  connections  having  more  than  one 
minimum-hop  route  are  assigned  a  route  in  such  a  way  as  to  evenly  spread  (balance)  the  load 
among  the  routes.  Then,  the  set  of  potential  connections  traversing  each  overloaded  link  i,  C(i), 
is 


C(1)  =  {(1,2),(1,3),(1,4)}, 

C{2)  =  {(1,3),  (1,4),  (2,3),  (2,4),  (2,5),  (7,3)} , 

(7(3)  =  {(1,4),  (2,4),  (2,5),  (3,4),  (3,5)}, 

where  (a,  h)  is  the  connection  from  node  a  to  node  6.  We  assume  that  the  feedback  information 
of  connection  (a,  6)  is  sent  along  the  path  of  connection  (i>,  a).  Note  that 


N,= 


3  ,  iVs  - 

\o) 


y 


where  Ni  is  the  vector  having  its  j-th  entry  equal  to  the  maximum  number  of  connections  that 
can  traverse  link  t  with  the  source  node  located  J  hops  from  this  link. 

In  order  to  obtain  more  realistic  results,  we  perform  the  simulation  using  a  discrete-flow 
model.  In  such  a  model,  the  traffic  flow  consists  of  discrete  rather  than  infinitesimal  packets  as 
in  the  fluid  model  used  in  the  previous  sections.  Specifically,  at  the  network  interface,  the  number 
of  packets  of  every  connection  (ab)  admitted  to  the  network  during  the  time  slot  [n,  n-b  1),  rai>(n), 
is  given  by  the  following  integrator-quantizer  equations; 

rai(n)  =  [saiin)  +  rat(n)J  , 

So6(n  +  1)  =  5a»(n)  +  r„t(n)  -  fafr(n),  Sai(O)  =  0 , 

where  ro6(n)  is  defined  by  the  control  protocol  (6.2),  Sok(w)  <  1  is  the  residual  traffic  of  connection 
(ab)  at  time  n,  and  [z\  denotes  the  integer  part  of  z.  In  addition,  within  the  network,  the  buffer 
of  each  link  is  searched,  every  r,  sec,  and  a  discrete  packet  is  selected  for  transmission  on  each 
link  according  to  the  service  discipline  in  use  (RTFS  or  FCFS). 

6.4.3  Robust  design 

The  data  for  the  robust  design,  based  on  Theorem  6.4  and  Theorem  6.5,  consists  of  the  largest 
round  trip  delay  Di  and  the  vector  of  maximum  number  of  throttled  connections  X,-  for  each  link 
i.  Let  denote  the  number  of  hops,  along  the  path  of  connection  (ab),  between  node  a  and 
the  origin  node  of  link  i.  Then,  as  it  follows  from  (6.23), 


A  = 


max 

(a6)€C(.) 


E  (1-©+  E  Co 

(ab)€C»‘(i)  (oft)6C*+>(*) 
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where 


=  f*:!--!  +  a;Jt, 

aab  r_a6l  _afc 

“iai  I  ^iai  \  ^iai  > 

C‘(i)  =  {(a6)  €  C(i) :  fr»Jl  =  t} , 

and  T  is  the  one-hop  delay  measured  in  time  slots  T.  Neglecting  processing  delay,  (6.6)  gives 

T,  +  Tp  T,  +  IOt, 

’■=  — =  ^o;r  = 

Carrying  out  the  computations,  we  obtain 

Di  =  0,  i,  =  (3), 

D-i  =  4,  Zj  =  (3,  0,  0,  2.7,  0.3)^, 

Da  =  6,  Za  =  (2,  0,  0,  1.8,  0.2,  0.8,  0.2)^  . 

The  values  of  the  D,’s  determine  the  structure  of  the  robust  controller  according  to  Theorem  6.4 
as  follows: 

Gi  =  (kioio  *1  e  (0,fci),  with 

ajo  =  2,  ail  =  — 1> 

(?2  =  (Arjajo  ^20^21  •••  ^24)  >  ^2  ^  (^>^)> 

020  =  *8,  021  =  ”*6,  020  ~  021  —  0,  022  ~  ~-2>  023  =  '"•4*  024  ~ 

G3  —  (/baoao  ksoizi  0^0  02\  •  •  •  033  )^ ,  Ara  €  (0,  A^),  with 

Oao  =  .71,  oai  =  —-.57,  ^30  —  1.29,  02\  —  >14,  0^/2  “  0, 

033  —  “*14,  023  —  —.29,  ^35  =  —.43,  023  —  —.57 .  (8*41) 

The  values  of  k*  are  functions  of  Li  and  are  determined  by  solving  the  optimization  problem  of 
Theorem  6.5  to  obtain 

kl  =  0.444,  =  0.178,  =  0.264 . 

Note  that  the  controller  gains  for  the  other  links  can  be  determined  in  a  similar  way  but  for  the 
purpose  of  this  simtilation  any  set  of  gains  satisfying  (6.16)  is  appropriate. 

The  behavior  of  the  network  with  Gi  defined  by  (6.41)  for  ki  =■  0.95  A;*,  t=l,  2,  and  3,  is 
shown  in  Figure  6.2.a.  Figure  6.2.b  corresponds  to  the  case  where  the  service  discipline  is  FCFS 
instead  of  l^FS.  Each  figure  includes  simulation  traces  for  the  changes  over  time  of  the  buffer 
occupancy  and  the  admission  rate  for  each  of  the  links  1, 2,  and  3.  The  results  can  be  summarized 
as  follows: 

(a) .  When  a  link  is  overloaded  (starting  at  time  t=50,  1000,  and  1500  for  links  2,  3,  and  1, 

respectively),  the  buffer  is  kept  in  the  vicinity  of  x°  =  30,  with  fluctuations  whenever  a 
new  connection  is  initiated  or  an  established  connection  is  terminated. 

(b) .  As  the  input  traffic  to  the  network  changes,  the  admission  rates  9i(n)  converge  to  a  new 

steady  state  in  order  to  maintain  max-min  fmmess  or  the  rate  allocation. 

(c) .  The  FCFS  discipline  exhibits  stable  (non-oscillatory)  behavior  whereas  oscillations  are 

observed  during  the  time  interval  |2000,3000)  when  the  RTFS  discipline  is  used.  This 
better  performance  justifies  the  choice  of  the  FCFS  discipline  although  its  stable  behavior 
was  shown  by  simulation  and  not  analytically. 
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The  reason  for  the  oscillations  is  the  following:  During  the  time  interval  (2000,3000),  the  throt¬ 
tling  link  for  connection  1,  i.e.,  the  link  which  has  the  minimum  admission  rate  q  among  all  links 
in  the  path  of  connection  1  (links  1,  2,  and  3),  is  not  unique  since  the  steady  state  rates  and 
93  are  equal  (92  =  93  =  c/3)  during  [2000,2500)  and  9i  =  92  =  93  =  c/2  during  (2500,3000). 
These  steady  states  correspond  to  corner  points  in  the  piece-wise  linear  nonlinearity  (6.5).  The 
oscillations  are  due  to  this  fact  and  to  the  fact  that,  under  the  RTFS  discipline,  connections 
are  treated  differently  by  the  transmission  links  depending  on  whether  or  not  they  are  throttled 
by  that  link.  In  fact,  Figure  6. 3. a  shows  the  result  of  the  interaction  between  the  nonlinearity 
and  the  RTFS  priority  scheme.  This  figure  is  a  plot  of  the  buffer  occupancies  of  traffic  belong¬ 
ing  to  connections  1  and  5  at  the  buffer  of  link  1.  During  the  time  interval  (2500,3000)  when 
9j  =  92  =  93,  connection  1  is  either  given  priority  by  link  1  and  therefore  its  buffer  occupancy 
is  zero  or  equally  shares  the  link  capacity  with  connection  2  and  therefore  both  have  an  occu¬ 
pancy  of  x°/2.  Figure  6.3.b  shows  that  no  such  oscillations  take  place  under  the  FCFS  priority 
discipline. 

6.4.4  Adaptive  design 

In  this  section,  we  design  an  adaptive  controller  and  examine  its  performance  for  both  priority 
disciplines  considered  above,  RTFS  and  FCFS. 

The  characteristic  polynomial  in  (6.34)  has  dimension  A  +  2  and  therefore  the  gains 

are  specified  by  the  choice  of  Di  -1-  2  desired  closed  loop  poles.  For  instance,  if  we  choose  the 
desired  characteristic  polynomials  as 


Pr.(A)  =  (A-A,){A-A2), 

/V,(A)  =  (A-A,)"(A-A2)^ 

/V3(A)  =  A^(A  -  Ax)"(A  -  A2)^  Ai,2  =  0.6±;0.1, 
then,  as  it  follows  from  (6.38),  the  adaptation  of  the  controller  gains 

~  Q'll  ^,0  ^il  •  •  • 

to  changes  in  Li  takes  the  following  form: 

G.(n)  =  -  l))]-'fi,  i  =  1,2,3,  (6.42) 

where 

f  1  =  (0.8,  -0.63)^ , 

A  =  (-1.6,  4.43,  -4.39,  2.01,  -.49,  .05)^, 

fa  =  (-1.6,  4.43,  -4.39,  2.01,  -.49,  .05,  0,  0)^. 

The  simulation  results  of  the  network  with  controller  (6.42)  and  the  service  disciplines  RTFS 
and  FCFS  are  shown  in  Figure  6.4.a  and  Figure  6.4. b,  respectively.  From  these  figures  we 
conclude: 

(a) .  The  adaptive  approach  achieves  better  transient  behavior  in  terms  of  speed  of  the  response 

and  buffer  overshoot  than  the  robust  approach. 

(b) .  The  superior  performance  of  the  adaptive  controller  justifies  its  selection  for  implementation 

despite  the  extra  computational  time  it  requires. 

(c) .  As  in  the  case  with  robust  design,  the  network  with  the  RTFS  discipline  is  prone  to  oscil¬ 

lations  whereas  stable  behavior  is  achieved  with  the  FCFS  discipline. 
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design. 


6.5  CONCLUSIONS 


This  report  presents  a  theory  for  analysis  and  design  of  a  congestion  control  systenn  in  store- 
and-forward  networks  with  multiple  congested  nodes.  Within  the  framework  of  the  controller 
structure  and  system  architecture  introduced  here,  it  is  shown  that  the  network  is  decoupled  in 
the  sense  that  its  analysis  and  design  can  be  carried  out  for  each  link  separately  without  regard 
to  the  others.  Based  on  this  decoupling  property,  we  show  that  the  design  of  the  congestion 
controller  for  each  link  is  accomplished  as  follows: 

1.  Using  Theorem  6.3,  choose  the  order  of  the  controller  that  guarantees  the  existence  of 
stabilizing  gains. 

2.  If  the  adaptive  controller  is  used  (i.e.,  the  gains  are  adapted  to  the  specific  input  traffic 
and  network  conditions),  select  the  controller  gains  bcised  on  formula  (6.38). 

3.  If  the  robust  controller  is  used  (i.e.,  the  gain  ensures  stability  for  all  admissible  input 
traffics  and  network  conditions),  select  the  parameterized  controller  gain  as  indicated  in 
Theorem  6.4  and  a  specific  gain  based  on  Theorem  6.5. 

Both  the  adaptive  and  the  robust  designs,  with  the  gains  selected  appropriately,  ensure 
asymptotic  stability  of  the  network.  Numerical  simulations  show  that  the  network  with  the 
RTFS  discipline  exhibits,  in  some  regimes,  undesirable  oscillations  that  are  avoided  when  the 
FCFS  discipline  is  utilized.  Moreover,  it  is  shown  that  the  adaptive  controller  is  capable  of 
insuring  much  higher  performance  characteristics  as  compared  with  the  robust  one.  This  may 
justify  the  additional  computation  burden  necessary  for  the  implementation  of  the  adaptive 
approach. 
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10  APPENDICES 


APPENDIX  1:  PROOFS  FOR  SECTION  5.2 


The  proof  of  the  Theorem  5.1  is  based  on  the  two  lemmas  that  follow.  To  simplify  the 
notations,  rewrite  (5.33)  and  (5.34)  as  follows: 


where 


Y{n-\-\)  =  A{L)Y{n)  + B 


1  —  loao  —Iqoii  .  — —IqOij  —bo  —bi  —b-2 

1 

1 


(Al.l) 


A{L)  = 


-ao  -ai 


-aj  1  -  $0  -^1  -^2  .  -^K  ’ 

1 

1 


1  0 


y(n)  = 


x(n)  -  x« 
x{n  —  1)  —  X® 

x(n  -  J)  -  x°  „ 

9(n) 

g(n-  1) 


X®  +  r°  —  c 
0 


q{n  -  K) 


bo  =  lo{^o-l)-h, 
bi  —  ^00%  ~  ^<+1 »  *  — 
bi  =  = 

Lemma  Al.l:  The  characteristic  equation  corresponding  to  equation  (Al.l)  is 


(A1.2) 


det[A(L)  -  XI]  =  (-l)-'+^[A'^+*^(A  -  1)"  +  A-^(A  -  1)P^  +  X^-^+^PaPi],  (A1.3) 
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where  Pa,  P^,  and  Pi  are  polynomials  in  A  given  by 


Pa 

=  ooA"^  +  oiA"^  ^  . 

. .  +  aj, 

=  +  . 

•  •  +  ^K-> 

Pl 

=  /oA^  + /lA^-' +  . . 

•  +  Id- 

Proof:  Using  notations  (A1.2),  the  characteristic  polynomial  of  matrix  A{L)  can  be  written 
as  follows: 


det[A{L)  -  \I]  =  det(A/f)  = 


/  1  —  /oOo  —  A  — /oOl  •  ■  •  —ioOtJ-l  —loOtJ 
1  -A 


det 


-bo  -6i 


-bK  \ 


-Oo 


-ai 


1 


-A 

—aj  1 


1 


-A 


-^K 


1  -A  ; 


Expanding  Ak  with  respect  to  the  last  row,  we  obtain  the  following  recursive  equation 

det(Ax)  =  -Adet(v4jc_i)  +  (-l)*^det(I>x),  (A1.4) 

where  Ai  is  the  matrix  obtained  by  deleting  the  last  K  —  i  rows  and  the  last  K  —  i  columns  of 
matrix  A{L),  and  Z?„  t  =  1, . . . ,  A",  is  the  following  matrix: 

/  1  —  IoOq  —  A  — /oOi  • .  •  —iooij-i  —iooj  —bi  \ 

1  -A 


A  = 


1  -A 

y  -oo  — Oi  ...  -aj_i  -aj  j 

The  solution  of  equation  (A1.4)  is  given  by 


det(AK)  =  (-l)^[A^det(Ao)  +  f]  A^-Met(A)].  (A1.5) 

«=i 

Therefore,  to  complete  the  proof,  we  have  to  calculate  det(Ao)  and  det(Z?,). 

To  compute  det  (£),),  we  expand  Di  with  respect  to  the  last  column  and  obtain 

det(A)  =  (-l)''6idet(Afi)  -  ^,det(M2), 
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where 


^  1  -A 

^  1  —  loao  —  A 

—  IqOi  .  .  . 

—  IqOJ-I  —IqOIJ  '' 

1 

-A 

,Af2  = 

1  -A 

^  -ao  -ai 

. ..  -aj_i  -aj  j 

1 

1  -A  , 

After  successive  expansions  with  respect  to  columns,  we  obtain 


det(A/i)  —  — (ofoA"^  -f-  ^  .  -1-  Qj)  =  — Pa^ 

det(A/2)  =  (— l)‘^^^[(/oO!o  +  A  —  1)A‘^  + *  +  ■..  + /oQ'j]* 

=  (-l)-'+'|A-'(A-l)  +  („Pc.l. 


T  licrcforc 

det(A)  =  (-Ij-'+'ftPo  -  AA''(A  -  1)  -  A'oPo]. 

The  determinant  of  Ao  can  be  evaluated  analogously.  Indeed,  as  it  follows  from  its  definition, 
Aq  is  the  following  matrix: 

/  1  — /oQfo  ”■  A  —looti  ...  —Iqoij^i  —Iqqj  —bf)  \ 

1  -A 


-ao 


1  -A 

-tti  . . .  —aj-i  -aj  1  -  /9o  -  A  / 


Notice  that  this  matrix  is  the  same  as  the  matrix  corresponding  to  Di  except  that  the  last  column 
has  6o  instead  of  bi  and  X  — I  instead  of  /3,-.  Therefore, 

det(Ao)  =  {-iy-^^[boPQ  -  (^0  +  A  -  1)A*'(A  -  1)  -  (^^  +  A  -  l)/oPa]. 

As  a  final  step,  we  carry  out  the  summation  in  (A1.5)  and  obtain 

det(>lK)  =  -  1)>  +  A'^(A  -  l)(„Fa  +  X'^-‘(-kPa  +  3iA-'(A  -  1)  +  ff^Pa)], 

»=0 

=  (-1)''+-'[A'^+-'(A  -  1)«  +  A'^(A  -  l)/„Po  +  A-'{A  -  l)P^  +  loPaP^  -  Pa  E^A*-']. 


tsO 


(A1.6) 


The  last  term  in  this  expression  can  be  rewritten  using  the  definition  of  6,’s  to  give 
K 


PaE^A*"'  =  Palic,P^-((lo+l,)A''  +  (,A*'-'+l3A*'-*  +  ...  +  loA*'-'’«)l, 

=  Pa[(oP^  +  ioA''(A-l)-A*'-'’+>Pl).  (A1.7) 


»=0 
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Substituting  this  expression  into  (A1.6)  and  canceling  appropriate  terms,  we,  finally,  obtain  the 
statement  of  the  lemma.  ■ 

Let  M{L)  be  the  following  matrix: 

/  /o  0  1  \ 

h  to  —1  1 

h  h  —1 

M{L)  =  :  :  1  . 

Id  Id-\  —1  1 

0  Id  -1 

V  0  0  1  1  ...  1  / 


Lemma  A1.2:  In  the  system  under  consideration, 


det[M(L)] 


■  (S‘)^ 


Proof:  Expanding  M{L)  with  respect  to  the  row  next  to  the  last,  wr  obtain  the  following 
expression 

det[M(L)]  =  (-l)®li,det(B)  +  det(C),  (A1.8) 

where 


lo  1 

h  -1  1 
h  -1 

Id-1 

Id 

0  1  1 


,C  = 


1 

-1  1 

1  1 


lo  0  1 

h  lo  -1  1 

I2  h  -1 


Id-1  Id-2 
Id  Id-1 

0  0  11 


-1  1 
-1 
1 


Next,  we  calculate  the  determinant  of  B  and  C.  Expanding  B  with  respect  to  the  row  next 
to  the  last,  we  obtain 


det(B)  =  (-l)°lodet(Bi)  -  det(B2)  -  det(B3), 


(A1.9) 


where 
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/  lo  1 

h  -1  1 

/j  — 1 


Id-2 

^D-l 

VO  111 


\ 


1 

-1  1 

-1  1 
1  11/ 


Note  that  Bi  is  a  triangular  matrix  and  has  a  determinant  equal  to  1.  Expanding  with  respect 
to  the  last  column  and  then  the  first  column  of  the  resulting  matrix,  we  obtain 


det(B2)=  ^VirWetCB*), 

»=o 

where  B\  is  a  block  diagonal  matrix,  B2=diag{B2i,B22},  with  BJ,  and  BJ2  as  (*  x  t)-  and 
[(£>  —  1  —  t)  X  (B  —  1  —  ij]-dimensionaI  matrices,  respectively,  given  by 


(  1 

N 

1  ^ 

\ 

-1  1 

-1 

-1 

1 

,  B22  — 

1 

-1  1 

1 

-1 

1  J 

-W 

Therefore, 

«=0  i=0 

Expanding  B3  with  respect  to  the  last  column,  we  obtain 

det(B3)  =  det(B])  -  det( B|),  (Al.lO) 

where 


/  /o  1  ^ 

/  /o  1 

h  -1  1 

h  -1  1 

h  -1  1 

h  -1 

; 

,Bl  = 

=.  1 

Id-3  1 

Id-3  -1  1 

Id-2  1 

Id-2  -1  1 

\  Id-1  ^ 

Vo  1  1  1  ...  1  11/ 

Note  that  B|  has  the  same  determinant  as  Bj,  and  B|  has  the  same  structure  as  B3.  Let 
hD-\  =  det(B3)  and  6o_2  =  det(B|).  Then,  (Al.lO)  results  in  the  recursive  equation 


bn-i 


D-l 


-(-i)"  E  -  ‘o-i- 

1=0 
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=  Iq.  The  solution  to  this  equation  is 

1=0  »=o  t=0 

D-i  j 

j=0  t=0 

Therefore,  (A  1.9)  finally  becomes 

det(B)  =  (-i)%  +  (_i)®2';,  +  (_i)'>^'^,,, 

«=0  j=0  «=0 

=  (-i)%+2(-i)'’E'i  +  (-')'’EE'-  (Aiii) 

«=0  j=0  i=0 


with  the  initial  value  bo 


t: 


Now  we  calculate  det(C')  of  (A1.8).  Expanding  matrix  C  with  respect  to  the  row  next  to  the 
last,  we  obtain 

detCC)  =  (-l)^/D<let(C,)  -  (-l)^/D_,det(C2)  +  det(C3),  (A1.12) 

where 


(  ^  ^ 

\ 

(  lo  1 

lo  -1  1 

h  -1  1 

h  -1 

12  —1 

j 

1 

,C2  = 

; 

1 

Id-3 

-1  1 

Id-2 

-1  1 

Id-2 

-1  1 

Id-1 

-1  1 

\  0  111. 

..  1  1  1  y 

\  0  11 

1  ...  1  11/ 

f  lo  01 

h  h  ~1  1 

I2  h 

-1 

II 

;  ; 

1 

• 

Id-2  Id-3 

-1  1 

Id-1  Id-2 

-1 

\  0  0  1 

1  1 

...  1  1) 

Note  that  det(C'i)  =  =  —60-2  Wter  expanding  Ci  with  respect  to  the  first  row).  In 

addition,  det(C'2)  =  det(53)  =  ho-i  ,  ana  finally,  matrix  Cz  has  the  same  structure  m  matrix 

C.  Let  CD  =  det(C')  and  cd-i  =  det(C3),  then  from  (A1.12)  we  have  the  following  recursive 
equation 


CD 


D-2  i 


jsO  »=0 

D-2  i  D-1  j 

-h  13 13 13  +  CD-I, 


D-1  i 

-(-ij^EEfi 

j=0  i=0 


+  CD-I, 


with  the  initial  value 


/  /o  0  1  \ 

Cl  =  det  I  /i  lo  — 1  1  =  (/o)*- 

V  0  0  1  / 


After  some  algebra,  the  solution  of  this  equation  can  be  known  to  be 


D-2  j  /D-1 

=  -/oEE'.+  E'4 

i=0  i=0  V>=0  / 


Finally,  substituting  (A1.13)  and  (Al.ll)  into  (A1.8),  we  obtain 


detlM(i)|  =  ((D)’  +  2lDE'i+ fr'i)  . 

i=0  \  t=0  / 

=  (-S'')’ 

=  (S‘)’ 


(A1.13) 


Proof  of  Theorem  5.1:  Due  to  Lemma  Al.l,  with  J  =  1  and  K  =  D,  equation  (Al.3)  can 
be  factored  out  as  follows: 


det[A(L)-A/]  =  (-l)^+iA(A^(A-l)2  +  (A-l)P^  +  PaPLl, 

=  (-1)^+'A/V(A), 


(A1.14) 


where 


fMA)  i  +  7,A'’  +  . . .  +  7o„. 

The  coefficients  of  /V(A)  are  related  to  Q  and  L  through  the  following  equation: 


7i+2 

72-1 

73 

74 


7d+i 

7u+2 

0 


0  1  0 

lo  -1  1 

h  0  -1 

h 


=  M(L)Q  , 


Id  Id-1 
0  Id 


0  1 


where  the  last  row  corresponds  to  constraint  (5.31).  Due  to  Lemma  A1.2,  M{L)  is  nonsingular 
since  det(M(L))  =  (Z)£k)  U  >  1  (at  least  one  flow  is  being  quenched).  Therefore, 

for  any  given  characteristic  polynomial  coefficients  F  =  (7i,72> •  •  •  57i)+2)^5  the  corresponding 
vector  of  feedbaMdc  gains  exists  and  is  given  by 

Q = (M(i)r‘f , 
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where  f  =  (71  +  2, 72  -  1 , 73>  •  •  •  >  7d+2>  0)^. 


APPENDIX  2:  PROOFS  FOR  SECTION  5.3 


Consider  again  polynomial  Pri^)  defined  in  (6.34): 

/V(A)  =  +  7iA^+'  +  72A^  +  . . .  +  7d+2-  (A2.1) 

The  closed  loop  system  is  asymptotically  stable  if  and  only  if  Pr{^)  is  Hurwitz,  i.e.,  has  all 
zeros  located  in  the  interior  of  the  unit  circle  on  the  complex  plane.  The  coefficients  of  iV(A), 
7,, i  =  1,2, . . . , D  +  2,  depend  on  the  vector  of  quenched  traffics,  L  =  (lo, h,--  -, Id)^ ,  and  on 
the  controller  gain,  Q  =  .  The  problem  of  robust  controller  design  is  to 

choose  Q  €  so  that  Pr(^)  is  Hurwitz  for  all  L  €  £  where  £  is  defined  in  (6.39). 

Let  r  denote  the  vector  01  coefficients  of  /V(A),  i.e., 

r  =  (7ii72>-'->7D+2r- 

Note  that  the  coefficient  of  the  highest  power  of  PrM  is  equal  to  1  and  therefore  is  not  included 
as  a  component  of  F.  Let  V  denote  the  stability  domain  in  the  coefficient  space,  i.e.,  a  set  in 
such  that  for  all  F  €  P,  the  resulting  polynomial  PpiX)  is  Hurwitz.  The  nature  of  the 
stability  domain  has  been  analyzed  in  a  number  of  publications  (see  [19]-[20]).  The  following 
facts  are  of  importance  to  our  analysis: 

(i) .  Every  point  on  the  boundary  of  V  corresponds  to  a  polynomial  with  at  least  one  zero  on 

the  unit  circle  in  the  complex  plane. 

(ii) .  Let  5  be  the  set  of  all  F  €  such  that  the  resulting  polynomial  has  at  least  one  zero 

on  the  unit  circle.  Then  S  is  generated  by  the  equation 

D+2 

^  ^^e^{D+2-i)0  =  0,  <?  €  [0,7r], 

t=r 

D+2 

1+E7.c-''®  =  0,  0e[0,7r].  (A2.2) 

t=i 

(iii) .  The  set  S  is  composed  of  three  hypersurfaces.  The  first  two  are  {D  +  l)-dimensional 

hyperplanes  and  correspond  to  0  =  0  and  9  =■%  in  (A2.2): 

So:  1+E£i^7.  =  0, 

S,-.  1  +  (-1)‘7.' =  0, 

and  the  third  surface  is  generated  by  the  movement  of  a  D-dimensional  hyperplane  when 
the  parameter  9  takes  its  values  in  (0,?r): 

c  ./  l  +  E£;'7(Cos(i«)=0, 

*"1  Eg:f7i»»W  =  0. 
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(iv).  The  set  S  partitions  into  (2D  +  5)  open  sets.  The  stability  domain,  T>,  is  one  of 

them,  specifically,  the  one  containing  the  origin. 


To  utilize  these  facts,  we  represent  the  vector  of  coefficients,  F,  as  follows: 


r  =  +  r^, 


where,  as  it  follows  from(6.37). 


^0-2 
“  /^o  +  1 
^2  ~ 


loOtQ 

hoto  "I"  fflO!! 
hoto  + 


Fo  =  03-02  ,  F^  =  WaL  =  hao  +  I2011 


(A2.3) 


0D  —  0D-1 

—0D 


/jpCKO  d" 
hoti 


Vector  Fq  depends  on  L  whereas  F ^  does  not.  In  addition,  since  the  sum  of  the  coefficients 
of  P^'  (A)  is  zero,  no  choice  of  the  ^,’s  results  in  Pj'  (A)  being  Hurwitz.  Therefore,  the  idea  of 

the  proof  is  as  follows:  First  we  choose  Q  =  Qi  so  that  the  resulting  /Y'^(A)  is  as  “good”  as 

possible,  i.e.,  is  defined  by  F^  belonging  to  the  boundary  of  D.  At  the  second  stage,  using  Fq, 
we  modify  this  Qi  so  that  F^  +  F^  €  D  for  all  X  €  D-  The  following  two  lemmas  implement 
this  idea. 

Lemma  A2.1:  Assume  that  Qi  is  given  by 


ao  = 


ai  =  - 


0i  = 


D  +  4 
2(D  +  1)’ 

D  +  2 
2{D  +  iy 
3D 

2(D  +  1)’ 

D  -  2(t  +  1) 

2{D  +  l)  ' 


i  =  1,2,  ...,D. 


(A2.4) 


Then,  F ^  belongs  to  the  boundary  of  the  stability  domain  T>.  Moreover,  F^  lies  on  the  part  of 

the  boundary  where  Se  and  So,  defined  in  (iii),  intersect.  □ 

Proof:  Every  point  on  the  boundary  of  the  domzdn  T>  corresponds  to  a  polynomial  with 
zeros  being  either  on  or  inside  the  unit  circle  (at  least  one  is  on  the  tmit  circle).  We  will  show 
that  Py'^  has  two  zeros  equal  to  1  and  D  zeros  inside  the  unit  circle. 

The  expression  of  (^)  can  be  obtained  using  the  coefficients  of  F  a  in  (A2.3): 

0  ^ 


Pr^W  =  EM, 


(A2.5) 
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where 


PpW  = 

t=0 

Since  P^{\)  =  =  0,  we  can  factor  out  (A  —  1)  in  P^i^)  to  obtciin 


P^{X)  =  (A-l)^\''j:V,)A‘, 

i=o  i=o 

=  {A-1)EAA‘, 

«=o 


where  =  '^f-Q  '  /9j.  Substituting  (A2.6)  in  (A2.5),  we  have 


(A2.6) 


P^  (\)  =  (A  -  l^A^  +  5:  ^.A‘], 

P  t=0 

=  (A-im(A), 


(A2.7) 


where  Pa(X)  =  A^  +  AA’-  Equation  (A2.7)  shows  that  has  two  zeros  on  the  unit 
circle,  and  we  now  show  that  the  zeros  of  P^{X)  are  inside  the  unit  circle.  We  start  by  evaluating 

h 

a  =  '’v'/j  3g  °A-\P-2(j  +  i) 

h  ’  2(^’  +  l)  2(C+1)  ’ 

1  D-l-i  D-l~i 

=  :;7n^  fag  -t-  (g  -  1  -  i)iD  -  2)  -  2^  ’  - •>]  . 


Therefore, 


2{D+1) 

1 

2(I>+1) 


(I>  +  2-i)(l+0. 


2(D+l)P-^(X)  =  2(D+1)A®+ E  (£'  +  2-0(1  + OA’, 


=  Do +  2-0(1 +  0A', 
•=0 
D 

= 

«=o 


(A2.8) 


where  a,-  =  (Z?  +  2  —  t)(l  +  i).  To  show  that  the  polynomial  Ya=o  ®«A’  bas  all  its  zeros  inside  the 
unit  circle,  we  use  Raible’s  tabular  form  for  Jury’s  stability  test  [21].  It  is  a  (Z)  +  1)  x  (D  f  1) 
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triangular  table  U  {uij  is  defined  for  j  <  £)4-2  — t),  where  the  first  row  consists  of  the  coefficients 
of  the  polynomial: 

uij  =  flD+i-j,  j  =  1,2,...,/)  +  1,  (A2.9) 


and  the  entries  of  each  row  i,  i  =  2, 3, . . . ,  D  +  1,  are  defined  in  terms  of  the  entries  of  row  i  —  1 
as  follows: 

Uij  =  Ui.ij  -  J  =  1, 2,  ...,£>  +  2  -  f.  (A2.10) 


The  stability  condition  is  that  all  the  entries  of  the  first  column  have  the  same  sign. 
With  the  a,’s  as  defined  in(A2.8),  the  entries  of  the  table  are  given  by 


Uij  —  {D  +  2)- 


Vi 


Vi-l,l 


where 

Vij  =  (D+Z—i—j)  +  j)D^  —  +  2ij  —  6i  —  5j  +  2)D  +  +  3i^j  —  —  15ij  +  26t  +  18j  —  12) 

i  =  0,1,...,/)  + 1,  j  =  l,2,...,/)  +  2-f. 

Indeed,  after  some  algebraic  manipulations,  one  can  show  that  u,j  as  defined  above  satisfies 
(A2.9)  and  (A2.10).  The  entries  of  the  first  column  are 

u,i  =  (D  +  2) — ,  t  =  l,2, ...,D  +  1. 

Ui-1,1 

Here 

Uii  =  (/)  +  2-0[(t  +  l)/)^-(i2-4i-3)/)  +  i(i^-6f2  +  llt  +  6)], 

=  (/)  +  2  - 

where  w{i)  =  (* +  1)/)*  —  (z*  — 4t  — 3)D  +  5(1^  — 6i*  +  llz  +  6).  The  sign  of  Uji,  i  =  0, 1,. ..,/)  +  !, 
is  equal  to  the  sign  of  u;(t)  which  can  be  rewritten  as  follows: 

w{i)  =  -  (/)  +  2)P  +  (/)*  +  4/)  +  +  /)"  +  3/)  +  2. 

o  o 

To  determine  the  sign  of  w{i),  we  take  its  derivative: 

=  i^-2{D  +  2)i  +  D^  +  W  +  j, 

=  (*  -  *i)(*  -  *2). 


where 


i,  =  D+2  +  ^. 
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\ 

\ 

\ 


Figure  A2.1:  Stability  domain  in  coefficient  space. 


Therefore,  w{i)  is  increasing  for  t  <  £)  +  1  <  and  since  iw(0)  =  +  3D  2  >  0,  then 

io(t)  >  0,  t  =  0, 1, . . . ,  Z?  +  1.  Thus,  Uji,  i  =  1,2,  +  1  is  positive.  Since  there  is  no  change 

of  sign  in  the  first  column  of  the  table,  P^{^)  has  all  its  roots  inside  the  unit  circle. 

To  complete  the  proof,  we  show  that  T ^  lies  on  the  part  of  the  boundary  where  Sg  and  So 

intersect.  Indeed,  let  Sg  denote  that  part  of  the  boundary,  i.e.,  Sg  =  lim«_o  Sg.  Then,  using  first 
order  approximations  of  cos 5  and  sind  {cos 6  1,  sinO  9),  Sg  is  defined  by  the  equations 


/  =  -1, 

=  0. 


It  can  easily  be  shown  that  T ^  satisfies  these  two  equations. 
As  it  follows  from  (A2.3),  vector  can  be  represented  as 

r4  =  i:w, 


where 


{VoVi  ...  Vb)  =  W^Q  = 


Oo 

Oi  Oo 

a\ 


Let  To  be  the  plane  tangent  to  Sg  at  the  point  F Then,  the  two  planes.  So  and  To,  divide  the 

space  into  four  quadrants  (see  Figure  A2.1). 

Lemma  A2.2:  Points  F^  +  \^,  x  =  0, 1, . . . ,  D  belong  to  the  interior  of  the  quadrant  that 

contains  the  origin.  □ 

Proof:  If  Ns  and  Nj  are  vectors  normal  to  the  hyperplanes  So  and  To,  respectively,  as  shown 
in  Figure  A2.1,  then  we  need  to  show  that 

{Ns,V^  >  0,  t  =  0,l,...,Z), 

{Nt,V^  >  0,t  =  0, 
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(A2.11) 

(A2.12) 


where  {U,V)  denotes  the  dot  product  of  the  vectors  U  and  V.  Inequality  (A2.11)  can  be  easily 
shown  to  hold  since,  from  the  equation  of  the  hyperplane  So,  we  have  Ns  =  (1,1,...,!)^  and 
therefore 

{Ns,  Vi)  =  ao  +  Q!i  =  ^  >  0. 

To  find  Nt,  we  first  compute  iVj(r)  which  is  a  vector  normal  to  Sg  at  a  point  F,  and  then 
calculate 

Nt  =  limAf,{r)|  (A2.13) 

Since  Sg  is  defined  by  the  equations 


fi{T,e)^Y:?=V-liCosi6  +  l  =  0, 

Mr,0)  =  Y:?=V^ismie  =  Q,  eeio,n). 


(A2.14) 


the  j-th  component  of  Ng{r)  is  given  by  [22] 


d'fj  86  86 

D+2  £>+2 

{cos  j6){^  27, cos t^)  —  (sinj^)(—  ^  t7isint^), 

i=i  t=i 

Z)+2 

*7, (cos  j6  cos  i$  +  sin sin  i6), 

«=i 

Z5+2 

27,  C0S(2  -  j)6. 
i=l 


(A2.15) 


Since  =  O’  Ng  vanishes  in  the  limit  6  =  0.  To  avoid  this,  we  factor  out  the  term 

i^(D+i)e  show  that  Nt  can  be  characterized  as  follows: 


Nt  =  iim 
0 


sinfZ/ 


+  1)5 


sim  5 


Ng 


r=r 


Indeed,  from  (A2.14)  we  have 


7i  = 

lD+2  = 

Substituting  in  (A2.15)  we  obtain 

-1 


7.  sin{D  +  2-  i)6  +  sm{D  +  2)5 
sin(/?  +  l)5  ’ 

7,  sin(2  -  1)5  -  sin  5 


sin(Z?  + 1)5 


£>+1 


+  g  7*,),  i  =  1,2, . . . ,  O  +  2, 


63 


where 

V’j  =  sin(D  +  2)^cos(j  —  1)^  —  (£)  +  2)sin^cos(£) -I- 2  —  j)^, 

V’o  =  sin(Z?  +  2  —  i)6cr‘<i[j  —  1)^  +  (D  +  2)sin(i  —  l)^cos(D  +  2  —  j)0  —  tsin(D  +  l}0cos(i  —  j)0. 
For  positive  integers  a  and  6,  the  following  identities  hold: 

^q  — 1  j 

sina^  =  52  (-1)*  (  “  )  (cos (sin 


sina^  =  (-1)*  (  2Jfc+ 1  ) 

/  b\ 

cosbd  =  £(-l)'  {^21  )  ^'(sin0)*', 


where 


Therefore, 


(n  '\  _  n(n  -  l)(n 
m  )  ~ 


—  2) . . .  (n  —  (m  —  1)) 
mi 


g— 1  j 

sina^cosM  =  51  (  2Jb  +  1  )  (  2^/  )  ''*+')-^(sin0)2(*+')+\ 

=  a(cos ^)“‘‘'‘’“^sin gin^ 6  +  U^, sin* 6, 


where 


uu  =  ( 2*+ 1 )  ( 2/ ) 

Using  this  identity,  we  obtain 

V’j  =  {{D  +  2)((cos  9)^'*'^  —  (cos  sin  9 

-  {  [(  '^  ^  ^  )  +  (O  +  2)  (  ^  2  ’  )]  (““ -  (f  +  2)  (  ^  "^2  “  ■'  )  (cos si. 
+  {C^D+sj-i  -(.0  +  2)y*o„-,}  do'  «. 

The  first  term  can  be  further  factored  out  since 


=  (cos 

^)0+3-i 

[(cos  9Y^ 

- 1) , 

=  (cos 

g)D+2-j 

[(1  —  sin* 

ey-'  - 1] , 

=  (cos 

9^D+2-j 

E(-i)‘  1 

f}-l  \  ■  : 
1  k  r™ 

fe=i 

=  (cos 

9)D+2-j 

-O'  - 1) 

sin*  9  +  sin^  i 
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Therefore, 


=  -(C  +  2)(;-1)-(®  +  ^)-(Z>  +  2)(^;>)+(D  +  2,('’+|-^), 
=  \iD  +  \){D  +  2){D  +  Z-3j)^i,. 

O 

For  tl’ij  we  have 

r/.„  =  {(D  +  2  -  O(cos0)^-‘+^  +  {D  +  2)ii  ~  l)(cos0)^+‘-^  -  i{D  +  l)(cos0)^+l‘'-''}  sinfl 

+  (D  +  2)  (’3'  )+('-')(  ^'’'2”'’  )  (cos«)®+‘-'-" 

(^3  '  )+(^  +  '>(''2'’  ') 

+  +{D  +  2)t^f_i,D+2-i  “  *^D+l,l.-j|}  ^• 

If  *  -  J  >  0>  the  coefficient  of  sin  6  is  equal  to 

(D +  2-  i)  [(cosd)^--^  -  (cos0)^+*--^] 

=  {0  +  2-  i){cos6f-*+^  [1  -  (cos<?)"<‘-^>] 

=  (D  +  2-i)(cosef-'*‘ 

=  (D  +  2-i)(cos9)°-+'  (i-;)8m^9-sin<oiC(-l)‘’( 'T'’ • 

ife=2  V  /  . 

If  i  —  j  <0,  it  is  equal  to 

{D  +  2){i  -  1)  [(cos0)^+’--^  -  (cos0)^''+^] 

=  {D  +  2)(i  -  l)(cos0f-^'-’  [1  -  (cos0)^I'-’)] 

=  (D  +  2)(t-l)(cose)^+-^  O-i)sin"0-sin"6>£(-l)‘('^^*  ]sin"<*-’)0  . 

fc=2  '  > 

Therefore, 

lim  .  =  {D  +  2  —  i){i  —  j)/,_,>o  +  {D  +  2)(t  —  l)(j  —  »)/<_, <0 

9-»o  sin  0 

—  <»t}1 
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where  /  is  the  indicator  function.  Thus, 


sin(D  +  1)5  ^  ^ 

sin3  5 

To  obtain  Nj,  we  need  to  substitute  T  =  V ^  in  (A2.16).  Since 

^  2(T)  + 

the  j-th  entry  of  Nt  is  given  by 


AT.  =  lin.  _sm(fl  +  l)g  , 
^  tf-0  sin^  6  ^ 


r=r 


1  D+\ 

^  ~  dTi  S 


.=2 


After  some  algebraic  manipulations,  it  can  be  shown  that 

^+1  1 

E  (<>  =  +  2)(C  +  3  -  2j) , 

«=2 


(A2.16) 


and  as  a  result 


(Z?  + !)(£>  + 2) 
12 

{D  +  l){D  +  2) 
12 


[i{D  +  3  -  3i)  +  £>(£>  +  3  -  2j)] 
[(I>  +  3)(Z)  +  4)-2(Z)  +  6);]  . 


Finally,  the  dot  product  in  (A2.12)  is 


(JVt,K)  =  OoAlj+'+ttiJVj”, 

=  2(oTT)  ~  ’ 

=  ^  (2(0  +  3)(0  +  4)  -  2(0  +  6)((0  +  4)(i  +  1)  -  (D  +  2)(i  +  2)))  , 

D  +  2 

=  ^l(0  +  3)(O+4)  +  (O  +  6)(O-2.)l, 

=  h(i).  (A2.17) 


Since  /i(t)  is  a  decreasing  function  of  i  and  h{D)  =  {D  +  2){D  +  12)/12  >  0,  then  h{i)  >  0,  t  = 

0,1,...,!?. 

Therefore,  the  set  of  points  {T  €  :  T  =  T^  +  VJ,  *  =  0, 1, . . . ,  belongs  to  the  interior 

of  one  of  the  four  quadrants  determined  by  So  and  To.  Since  F^  + 13^:0  ^  belong 

to  the  quadrant  cont2Lining  the  origin.  ■ 

Proof  of  Theorem  5.2:  The  vector  of  control  gains  Qi  defined  in  (A2.4)  guarantees  asymp¬ 
totic  stability  of  the  network  for  all  T  €  £  if  and  only  if  the  set 

nQi)  =  |r  e  mP-^^ :  r  =  v^  +  pjiVi  =  Wai,  vi  e  rj  = 


r  -  space 


Figure  A2.2:  Mapping  of  C.  into  . 


lies  inside  V.  The  set  £,  as  defined  in  (6.39),  is  a  rectangle  and  Hi  is  obtained  from  C  through 
an  affine  map  since  for  every  point  F  €  there  exists  L  €  C  such  that  F  =  +  WqL. 

Therefore,  Hi  is  a  polytope,  i.e.,  it  is  the  convex  hull  of  2^"^^  polynomials  obtained  by  setting 
L  to  an  extreme  point  in  C  (see  Figure  A2.2).  Note  that  since  the  extreme  point  0  is  excluded 
from  £,  the  point  F^  is  excluded  from  Hi. 

From  the  foregoing  discussion  regarding  the  characterization  of  the  stability  domain  X?  and 
the  location  of  F^  (Lemma  A2.1)  and  the  VJ’s  (Lemma  A2.2)  resulting  from  the  choice  o(Q  =  Qi, 

we  conclude  that  there  exists  ki  sufficiently  small  such  that  the  polytope 

nQki)  =  {r  e  :  r  =  F^  +  hWal  =  F^  +  f^likiVi,  VI  €  £}  =  Hk, 


is  such  that  Hk^  C  V  and  that  there  exists  kz  sufficiently  large  such  that  the  polytope  Hka  ^  P. 
More  precisely,  there  exists  jfc*  >  0  such  that  Hk*  intersects  the  boundary  of  "D  and  for  any 
k  €  (0,  k*),  the  polytope  Hk  is  inside  V.  The  number  k*  is  the  smallest  k  for  which  the  polytope 
Hk  comes  in  contact  with  the  boundary  of  D,  That  is,  Hk*  is  the  largest  polytope  whose  interior 
points  correspond  to  stable  polynomials.  ■ 

Proof  of  Theorem  5.3;  As  it  follows  from  the  proof  of  Theorem  5.2,  fc*  in  the  smallest  k 
for  which  the  polytope  Hk  intersects  the  boimdary  of  P  which  consists  of  the  surfaces  So,  5, 
and  Sff.  The  polytope  Hk  does  not  intersect  the  hyperplane  So  for  any  k  since,  due  to  (A2.11), 
Hk,  k  e  lies  in  one  of  the  two  half  planes  generated  by  So-  Therefore,  Hk  can  intersect  only 
Sn  or  Se  or  both.  Let  ki  {k2,  respectively)  be  the  smallest  k  for  which  Hk  intersects  5,  {Sg, 
respectively).  Then, 

ki  =  inf 
ib>0 
TeHk 


k. 


(A2.18) 


and 


fcj  =  inf  k. 
k>0 
TeHk 

TeSg 


(A2.19) 


If  Hk  does  not  intersect  Sr  {Sg,  respectively)  we  set  the  solution  of  (A2.18)  ((A2.19),  respectively) 
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to  4-00.  From  the  above,  it  is  clear  that 

k*  =  min{A:i, 

The  optimization  problem  (A2.18)  and  (A2.19)  can  be  rewritten  in  the  form  used  in  Theo¬ 
rem  5.3.  Indeed,  first  we  rewrite  them  as 


inf 
ib  >  0 
LeC^ 

+  WaL  e  5, 


(A2.20) 


respectively,  where 


inf 

jk>  0 

+  WaL  6  8$ 


(A2.21) 


=  x...x£^)-{0},  £*  =  [0,fc/i],i  =  0, 

Since  for  £  =  0,  F  is  equal  to  which  does  not  belong  to  5,  or  8$,  we  can  include  L  =  0  in 
the  feasible  set  without  changing  the  infimum  in  (A2.20)  and  (A2.21).  Therefore, 


inf 

fc>0 

0<L<kL 
Ta  +  WaL  G  5, 


(A2.22) 


inf 

ik  >  0 

0<L<ki 

F/3  +  WaL  G  8e 


(A2.23) 


where  the  constraint  0  <  L  <  kL  denotes  the  component  wise  inequalities  0  <  /,•  <  kli,  i  = 

0, 

The  infimum  in  (A2.22)  can  be  obtained  in  closed  form.  Indeed,  substituting  F  =  F^  +  WaL 
in  the  equation  of  the  constraint  +  WaL  G  8$  becomes 


D 

E'<  = 

t=0 


3£>  +  5  +  (-l)^(Z?  +  3)  A 
2{D  +  3) 


The  constraint  0  <  £  <  kli  is  equivalent  to 

li  =  kliXi,  0  <  X,  <  1. 

Combining  (A2.24)  and  (A2,25)  and  solving  for  fc,  (A2.22)  becomes 


(A2.24) 


(A2.25) 


^1  =  inf  =n-~T — ■ 


(A2.26) 
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The  solution  of  (A2.26)  is  obviously 


ki  = 


a 


a 


Note  that  when  for  all  even  i,  are  equal  to  zero,  fci  =  +oo,  which  means  that  Tlk  intersects 
Se  but  not  S^-  ■ 


APPENDIX  3:  PROOF  FOR  SECTION  6.1 


Proof  of  Lemma  6.1:  Obviously,  there  exists  a  permutation  <t(1),<t(2),  . . .  ,<T(iVi)  of  the 
set  {1, 2, . . . ,  iVi},  not  necessarily  unique,  such  that 

9<t(i)  ^  9(T(2)  ^  ^ 

By  relabeling  qcr^i)  as  qi,i  =  1,2, . . .  ,fVi,  A  becomes  a  lower  triangular  matrix.  Indeed,  for  the 
relabeled  9,’s  we  have 

^  ^2  —  “  -  —  9Ni' 

We  need  to  show  that  Uj  =  0  for  t  <  j.  Assume  that  i  <  j  and  therefore  <  q^.  If  Uj  ^  0, 
then,  at  the  steady  state,  Uj  connections  throttled  by  link  j  traverse  link  t.  According  to  (6.11), 
this  means  that  qj  <  9,  wmch  contradicts  the  assumption.  Therefore,  Uj  =  0  for  t  <  j  and  the 
statement  of  the  lemma  follows.  ■ 


Proof  of  Lemma  6.2:  Let  B  be  the  neighborhood  of  the  steady  state  where  the  following 
holds: 

(a) .  The  sets  t  =  1, 2, . . . , iVi,  j  =  0, 1, . . . , iVi,  are  constant. 

(b) .  The  rate  of  the  remote  throttled  traffic  remuns  less  than  the  link  capacity,  i.e.,  fj;{n)  < 

c,  i  6  Afi. 

(c) .  The  rate  of  traffic  traversing  underloaded  links  remains  less  than  the  link  capacity,  i.e., 

fi{n)  <c,ie  A/’2. 

We  show  below  that  B  is  not  empty.  Note  that,  as  it  follows  from  (a),  the  values  of  rf  and 
*i  J  €  Ml,  are  constant. 

Assume  that  the  network  state  is  in  B.  Then,  according  to  the  RTFS  priority  discipline 
introduced  in  (xv'j,  the  remote  throttled  traffic  does  not  incur  any  queueing  delay  at  the  bufiFer 
of  link  i  since  it  is  given  priority  and  it  has  a  rate  fji  less  than  the  link  capacity.  Traffic  of 
throttled  connections,  on  the  otW  hand,  might  be  queued  at  the  buffer  of  the  throttling  link 
and  share  the  residual  capacity  c  —  /jj  on  a  first-come-first-serve  basis.  Therefore,  connections  see 
a  change  in  their  rate  only  at  two  points  along  their  path:  at  their  point  of  entry  to  the  network 
and  when  they  traverse  the  buffer  of  their  throttling  link.  Thus,  during  the  time  slot  [n,n  +  1), 


since  any  connection  (ab)  throttled  by  link  i  is  admitted  to  the  network  with  rate  ^.(n  -I- 1  -  d^^), 
it  will  reach  the  buffer  of  link  j  with  rate 

qi{n  +  1  —  T^aj)i  buffer  of  link  j  precedes  link  i  on  the  path  of  connection  {ab), 

min  (n  -  t“/),  "  ""d  ))  }  ’  otherwise.  (A3. 1 ) 

Therefore,  as  it  follows  from  the  definition  of  /„(n),  we  have 


/-(")=  E  9.("  + 1  - 

(a6)6t^>i 

Let  be  equal  to  1  if  link  i  precedes  link  j  on  the  path  of  connection  {ab)  and  0  otherwise. 
Then, 

=  +  (A3.2) 

i=l 


where 

/o(»)=  E 

(ab)£Ciy  ' 


xf  (n  -  r^t) 


Since  fij  is  a  function  of  f-jj,  /jj  can  be  obtained  recursively  starting  from  fu  =  It  is  clear 
from  (A3.2)  that  it  is  a  function  of  the  states  of  link  j  {q,  and  xf  at  present  and  in  the  finite 
past),  j  =  1,2, ...  ,i  -  1. 

Now  we  show  that  iB  is  a  nonempty  neighborhood  of  the  steady  state,  i.e.,  that  there  exists  a 
ball  of  positive  radius  around  the  steady  state  where  (a)-(cl  hold  true.  Due  to  assumption  (6.15), 
there  exists  a  neighborhood  B\  of  the  steady  state  where  (a)  is  true.  In  addition,  it  follows  from 
(A3.1)  that  the  rate  of  any  connection  through  any  link  depends  continuously  on  the  network 
state  and  as  a  result,  /j7(n)  and  /,(n)  are  continuous  functions  of  the  network  state.  Moreover, 
since  fji{n)  and  fi{n)  have  their  steady  state  values  less  than  c,  there  exists  neighborhoods 
and  Bz  of  the  steady  state  where  (b)  and  (c)  hold  true,  respectively.  Therefore,  B  =  Hi  0^2  flBa 
is  a  nonempty  neighborhood  of  the  steady  state  satisfying  (a)-(c).  ■ 


APPENDIX  4;  PROOFS  FOR  SECTION  6.2 


Proof  of  Theorem  6.1;  Indeed,  for  each  »  €  Mi,  the  pair  of  equations  (6.24)  and  (6.25) 
represents  the  dynamics  of  link  i  with  being  the  only  term  that  depends  on  the  states 

of  the  other  links.  According  to  Lemma  6.2,  /jK^*)  is  a  function  of  the  states  Yj{n)  of  lii^s  j, 
j  =  1, 2, . . . ,  i  —  1;  therefore,  the  dynamics  of  link  t  is  not  influenced  by  the  state  of  any  link  j 
with  j  >  i.  This  means  that  there  can  be  no  dynamic  coupling  between  the  links  since,  for  a 
coupling  to  take  place,  there  must  exist  a  set  of  links  i\,  t2, . . . ,  H  in  Mi  such  that  the  state  of 
link  ij  affects  the  dynamics  of  link  tj+i,  j  =  1, 2, . . . ,  A:  —  1,  and  the  state  of  link  t*  affects  the 
dynamics  of  link  1.  In  other  words,  the  linearized  form  of  (6.24)-f6.25)  has  a  block  triangular 
structure  where  the  t-th  diagonal  block  corresponds  to  link  i  ana  is  described  by  (6.26)  and 
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6.27^.  Therefore,  the  analysis  of  the  network  dynamics  reduces  to  the  analysis  of  (6.24)  and 
6.25)  separately  for  each  i  G  ^J'l  with  /jj(n)  treated  as  a  disturbance  to  the  dynamics  of  link  i. 


Proof  of  Theorem  6.2:  Obviously,  the  rate  of  nonthrottled  connections  cannot  be  increased 
without  violating  the  feasibility  constraint  (6.30).  To  increase  the  rate  of  a  connection  (ab)  throt¬ 
tled  by  link  t  while  maintaining  feasibility,  we  must  decrease  the  rate  of  some  other  connection 
(a'b')  traversing  link  i  in  order  to  maintain  the  feasibility  constraint  (6.31).  But  since  fab  —  Qi 
(by  definition  of  throttling  link)  and  fa'b'  <  9,-  for  all  connections  a'b'  G  C{i)  (by  definition  of  the 
control  protocol),  the  steady  state  allocation  satisfies  the  requirements  for  max-min  fairness.  ■ 


